One thing that people don't tend to take into account with roosters is the breed. Breed is everything, breed even has a say in how the hens will act. The best boy I have ever had was my little Cochin guy Po, and I didn't pick him up at all once I was sure he was a boy. I treated him like a rooster would treat another rooster, and he returned my efforts by keeping a respectful distance. I was unable to handle him in the daytime, but I also never had to warn anyone that there was a rooster around. He knew not to attack humans and he never did.
On the flip side, an Easter-egger boy raised at the same time as Po was INSANE. He would freak out if I got to close, and he was mean to the pullets, and he was just unpredictable. I tried to keep him in the same way as I kept Po, but then I had 'help' from my brothers city-slicker ex-girlfriend, who thought this guy was the cutest thing and was always wanting to hold him. I might be a bit bitter about the whole thing, but I'm relatively sure she's the reason he turned out as evil as he was.
Not a single Easter-egger rooster I have owned has been docile. All of them were either mean toward me or toward their hens. Obviously, other people have had other experiences, but many of the people I've read about with Easter-egger boys have had the same experience that I have had with them. I do not recommend Easter-egger roosters unless you want the colored eggs in the offspring.
Cochins, on the other hand, I would recommend to anyone. All of the people I've known through BYC that have had Cochin roosters as their flock guardians have had good experiences with them. My Po was a good example of this. I sure do miss that little guy.
One other breed whose roosters have been insane in my experience, all of which I tried to coddle and all of which returned that action with aggression, were production Rhode Island reds. About everywhere I have read has said that production reds are aggressive. I've even heard that there are some songs about mean red roosters that were based after production red boys! Heritage Rhodies are another story, though, and should not be confused with their hatchery-bred cousins.
Another thing to note, along the same lines as what Leahs mom was saying, is I had a production red raise two chicks, a Rhodie-mixed breed pullet and an Easter-egger cockerel, and they both turned out INSANE and evil (yes, even the pullet). The mother arrived here as an adult, was a bit human shy, and reacted strongly whenever we tried to hold the chicks. I imagine that does have some effect on how a rooster will behave as well. Apparently, it also has an effect on the pullets.
The point is, both genetics and how they are raised have an effect on their personalities. While there will be experiences both ways with handle vs. don't touch, you have to take everything into account and do what YOU think is best in how you raise your boys. My best experience was not handling them, and my best rooster was a Cochin, a breed known to be docile and calm. But everyone has their own thoughts, like M2H says, and it seems to be a very polarizing topic. I'm not gonna go any further than this because I know I lost my temper last time and I feel like I didn't make my point as strongly as I could have as a result, but take from it what you will, and in the end do what you think is best.
(Obviously this was toward Quinstar. Forgot to quote.)