You're confused. The pointer is different to the motion sensing. What you're saying makes sense, as when you're in the menus, the wiimote uses the IR sensor to tell the Wii where it's pointing. When you're playing Wii Sports however, then you are using the motion sensor.
Anyway, it sounds like a busted controller. Take it back to the store or call Nintendo support.