Anne, keeping his distance doesn't mean he'll be aggressive. I think it's in a roosters nature to be more distant and cautious. After all, it's their job to protect the flock from danger.
I held my rooster occasionally, but when he grew up I wanted to make sure he knew that I am top rooster, not him. So, I walk through him and make him yield to me, I don't let him mate in front of me (he's been knocked off a hen twice - not something he likes
), if I think he's getting a bit of attitude I'll walk around following him and he thinks I'm chasing him. So he's definitely not a cuddle rooster, which is fine with me. He's a good boy to my hens, a great protector and I can go in the run and turn my back and not worry about getting jumped. He will come running up for treats just like the rest and will eat out of my hand, so he's not afraid of me, just cautious.
My younger roo hates being held, but once I have him, he settles down. (as does my older one) He's tried to wing dance at me once, and he met my boot personally but gently. Just enough to correct his attitude. He's going to be a bit more strong willed, but so far he's being a good boy. He's not mating yet, so we'll see. I do the same technique with him that I did with my older rooster of making him yield to me.