Unfortunately when you make pets out of the roosters they loose their fear of you and don't respect you as head of the flock. Many well known breeders have suggested not to tame your roosters. You need to find a way to scare him into submitting to you. Bring a broom into the pen and go straight at him with it until he runs away from you. Each time you come into the pen, first thing you do is walk towards him and make him move away from you to let him know YOU own the hens. This has worked for me with most of my roosters. The ones it didn't work on have been sent to the auction.
Sorry you are having rooster trouble. Hope this works for you.