In no way would I tolerate a rooster showing aggression. Time to have that conversation with the neighbors ASAP. In the mean time, you can carry a stick with you. Feel free to smack some respect into those roos. Or hose them out of the yard. Are both roosters showing aggression at the same time???