This has happened to me a few times but I sorted it out. Make sure your Wii Remote has batteries that are completely charged. Also make sure there is no light shining against the Wii Remote, that causes distortion. You can keep lights on but the suns rays makes the sensory go wrong. Finally, make sure there are no metal objects in the way.
Hope I could help.