Like dogs, roosters sense your fear and some will take advantage of it to try to intimidate you. Spurring is about the most drastic and dangerous act a rooster can perpetrate on you. It often sends his victims to the ER for stitches. Bad dogs have nothing over a bad roo as far as being dangerous.
It's amazingly intuitive of you to realize your fear could be a problem with your relationship to your rooster. More often than not, a rooster turns bad because of the way their human relates to them. If you are afraid and do not take your role as alpha flock keeper seriously, he can get mixed signals, just as a dog when no boundaries are set. This causes anxiety and confusion, and many roosters will act out when they feel anxious.
Your objective is to convince yourself that you are the flock care taker and your rooster must show you respect. In return, you must show him you trust him to protect his flock and not interfere with his job. He will be more inclined not to interfere with your job.
If you are very lucky, his genes will make him a gentleman and he will require no discipline, but you need to be ready if he does. Many actions, seemingly benign, can lead up to spurring. It usually begins with him "courting" you by doing a dance in your direction. This is not acceptable, and make no mistake, it's not "cute". You are not a hen. You are the flock care taker. You correct this by reaching down and swiftly immobilizing him and holding him in place until he quits struggling. You aren't hurting him, but make no mistake, he will get the message loud and clear.
The respectful behavior of a rooster in your presence will be to move gracefully out of your way. If he doesn't, do not walk around him. Keep walking right at him until he moves to the side. You in turn will mostly ignore him. This will show that you trust him to do his job.
Some folks think, mistakenly, that you must not permit a rooster to mate a hen in your presence. This being one of his main jobs, by interfering with his mating, you are setting up a situation where he will feel you're trying to compete with him. Ignore him unless he's hurting a hen or trying to mate an older hen who wants no part of his attentions. This should be rare.
So, to summarize, get confident in your role as flock care taker, and that will conquer your fear. Ignore your rooster unless he misbehaves. Trust him to fulfill his role as flock protector.