In the desert, the broken piece of the bridge is sticking out of the dirt near the bottom right-hand corner of the map (it's actually right at the warp spot in the desert). Go there and ol' girl will start that giggling stuff. You can then warp to the Eldin bridge with the broken piece and tadah. You don't necessarily need to rebuild it to meet the Goron though. Could always just go around haha.