fall off pier

I am new to this game and I am stuck on the Castle Rooftop. I have tried about 60 times to jump from the pier to the roof with help from Midna, but when I jump to the pole, I fall. I have spent hours trying to jump or find another way to get to the other rooftop and cannot. I am dying to move on...