You can sell the keyboard on eBay. AOLspeak without the age requirement.
Anyways, perhaps there's a wire loose in your keyboard, and as you type and move the keyboard about the wire connects and disconnects, enabling and disabling Caps Lock. If you really don't like it, there is an option in...