If he is young, it could be that he is just testing the waters with you.
My rooster had a bit of a charge at me the other day, but to be fair I was holding his favourite girl at the time and he was obviously trying to protect her. In a way, this is why I got him in the first place, so I have given him the benefit of the doubt - this time. He has not attacked me before (he is 14 months old), and has not done so since. So I can see that perhaps I might need to modify my behaviour next time I need to work with that hen.
But as i said, this is the one and only time he has done it. A rooster that persistently attacks people is, in my opinion, not a good rooster to have around. I can understand the premise behind what @centrarchid is suggesting, and it may well work, but I personally would not tolerate a rooster consistently attacking me. Thick clothing will not protect your eyes, and if there is any chance at all that a small child could wander into his path who knows what damage could be done.
Me? I'd be having a good think about wether I really needed a rooster, and re-homing or culling him out. I fear that as you have indicated he has behaved aggressively on several occasions (by raising his hackles and stalking you) that the pattern is already set - there is a dominant member in your flock, and it's not you.
If you do intend to breed you could always get another rooster. I'm not sure that aggression is a trait I would want to breed on anyway. If you don't intend on hatching chicks, I'd be asking if you really need to keep a roo on hand at all.
Just my humble opinion. I'm sure others will have opposing opinions.
My best to you,
- Krista