Chickens love to perch during the day. They love flying up on things and just sitting there. The top of your fence is perfect for that since it has a rail up there. Once the get up there who knows which side they will hop down on.
The way I've handled that is to not give them a good place...