I've got a big Buff O rooster who is a doll. Literally. He talks to me constantly, lets me pet him but every now and again, he gets it in his little pea brain that he needs to bite me and show me who is boss. When he does that, I usually give him a hard flip on his beak or head with thumb and forefinger. If he does it again, the same. Third time he gets snatched off his roost, or caught and dangled by his ankles for a minute or so. Funny thing is once I dangle him, he starts talking to me like he's apologizing. I set him upright when he does that and test him to see if he is going to bite again. Usually that is enough to adjust his attitude for awhile, but every now and again I have to readjust his attitude. If he is being rough with a hen (he's barely a year old, matured late and a bit of a Klutz with the girls), I push him off of her and he will once again chatter at me as if asking me what I did that for. I usually tell him that I helped him out of his shell and I can just as easily help him into a soup pot if the need arises, but he knows he's pretty much safe with me.
I agree about using a broom to keep him at a respectful distance if you feel threatened by him. They hate the broom. You do not have to hit them. All you have to do is make sweeping motions and they will be heading rapidly away from you. I'm very lucky right now. I have 13 very nice roosters. I'm trying to find homes for about half of them if not more. I don't know what spring will bring when their hormones really start to surge (about a month from now if not sooner) but at the moment, they are all respectful and gentle with both me and their hens.
Roosters are going to be roosters though so expect the unexpected from them.