You can be spotted, it doesn't affect anything. Not being spotted just means you don't get shot at
I don't remember any particularly hard ones to find. There was one on the roof of a building you can only hit from inside the building through a hole on the floor, but other then that I got through them all pretty quick.
Now the cat game in that town was another story