I love roosters and would keep them all if I could. Mine are handled from day 1, but I don't put up with bad behavior. If they show any aggression toward me or other humans, I pick them up and football carry them for a while. This doesn't always work, and I'm not hesitant to cull for human aggression, even in very young cockerels.
My current 5 guys each have their own flock of varying sizes. In spring, like now, they all have to be kept separate, but by midsummer I'm able to free range all flocks together. The senior roo, Sweet Pea, my big Blue Orpington, keeps everyone else in line. My Brahma/Ameraucana cross Ursa just wants to stay out of everyone's way. My big Brahma boy Rocky has been my most challenging - he's a biter - but he's settling as he grows up (just turned 1 year old). And my two Bantam Cochins, Patsy and Meatball, well, they have little guy syndrome. Meatball wants to fight everyone he sees, but loves to be snuggled by humans. Patsy is less rooster-aggressive but similarly human-friendly.
I do think that if you keep more than one rooster, you have to have a tolerance for the occasional fight and a willingness to rehome or cull if the fighting goes beyond mild territorial squabbling. I still haven't successfully kept a bachelor flock, and Rocky and Meatball, once the best of friends, now have a deadly feud because they've discovered girls. Sigh.
My current dilemma is that I've hatched a gorgeous splash Brahma-Ameraucana cockerel and may need to figure out how to keep him. My patient and enduring husband has said, sure, I'll build you ANOTHER coop...