Cockerels and roosters need to be treated like they're the underlings at all times.  You are the boss rooster, and they can't forget that.  Otherwise they will one day try to treat you like they're the boss rooster, and beat the tar out of you or some small person.  
I read on here that you should watch the flock when you give them treats and keep the roo from eating until everyone else is done.  If he comes near you, kick at him so that he is leary of you.  Carry a big stick and swing it in his direction if you're near him.  If you see him mating a hen in your presence, run and chase him off.  Do all the things that he would do to another rooster to show that he was the alpha, and he'll learn that you're the alpha and should leave you alone.  Make sure that all the people in your household do the same thing.
My roos leave us alone totally.  When we sit outside to get the hens to come eat out of our hands, the roos stay around the outside perimeter and only eat what we throw to them after the hens finish.  Usually they cluck and scratch to show the girls where the good stuff is before they'll eat any for themselves.
I know of a family who had a pet bantam rooster of some type.  I'm not exactly sure what he was except that he was a bantam.  He had been the family pet, and they dearly loved him.  One day the 18mo daughter was out in the back yard with the roo while mom was in the kitchen cooking.  She heard the toddler crying, and ran outside to find the rooster on top of her, with her little scalp and face spurred pretty badly.  He had never even made a move at any of the people before that day and had been dearly loved, but one day he decided to strut his stuff...