It sounds like he is getting a bit on the rough side. You could do a few things:
A) get rid of him
B) put saddles on your hens
C) add more hens
Personally,if he is just there to be there and just be with the ladies, then I would just cull/replace him. If he is an actual rooster you want for...