If he is young, it could be that he is just testing the waters with you. 
 
My rooster had a bit of a charge at me the other day, but to be fair I was holding his favourite girl at the time and he was obviously trying to protect her.  In a way, this is why I got him in the first place, so I have given him the benefit of the doubt - this time.  He has not attacked me before (he is 14 months old), and has not done so since.  So I can see that perhaps I might need to modify my behaviour next time I need to work with that hen.
 
But as i said, this is the one and only time he has done it.  A rooster that persistently attacks people is, in my opinion, not a good rooster to have around.  I can understand the premise behind what @centrarchid is suggesting, and it may well work, but I personally would not tolerate a rooster consistently attacking me.   Thick clothing will not protect your eyes, and if there is any chance at all that a small child could wander into his path who knows what damage could be done.
 
Me?  I'd be having a good think about wether I really needed a rooster, and re-homing or culling him out.  I fear that as you have indicated he has behaved aggressively on several occasions (by raising his hackles and stalking you) that the pattern is already set  - there is a dominant member in your flock, and it's not you. 
 
If you do intend to breed you could always get another rooster. I'm not sure that aggression is a trait I would want to breed on anyway.  If you don't intend on hatching chicks, I'd be asking if you really need to keep a roo on hand at all.
 
Just my humble opinion. I'm sure others will have opposing opinions.
 
My best to you,
 
- Krista