The big thing is to be aware, and it sounds like you are. Also, watch your hens, how are they acting. However, I had a BA, and that is how he started, and he just kept getting worse, and meaner. I thought that it might just be the "teen years" (4 to 10 months), and that he would out grow it. But he didn't and he got meaner to me and the hens.
So watch and be aware, especially if he starts to watch you, he may try and sneak up behind you, and that is not a good sign.
You don't say how many hens you have, but for two roosters, you should probably have more than 20 hens, although many report on here with success with a higher roo/hen ratio, it is more of an exception. Your hens will start to look ragged, with bald spots and bare-backs from too much breeding.
Mrs K