Well, I would have to say go with the rooster. Sounds like your neighbor just doesn't want to hear a crow.
I love my roosters! They have all their own flocks who they protect, no major fights but I do keep them relatively seperated. Some breeds I have more than one rooster in a flock, others I don't.
I have to tell you, though... if you ever seen a rooster do his "alarm" that something isn't right, and the hens... they all freeze or duck under something, you wouldn't even be asking. Sure some are tempermental... even my kindest one will "bump" you (no claws or beak, but just a chest bump to say... "i'm in charge"). I do pick him up daily, and ALWAYS after a "bump". It's never a big deal. I guess people think that a rooster will run you down and slit your throat. It won't. My meanest rooster I ever had (who just got eatten by a fox two days ago - protecting the hen from the same fate) would try to chase you, but if you don't run... there is no chase. And I have never had a roo draw blood. So there are the two extremes I have dealt with personally.
If I didn't have a rooster for each flock, I would have lost hens on more than one occasion. I say go with the boy. Keep the natural order of things and let them be a flock with a guardian.
Besides all that.... if you want to have your own chicks or sell hatching eggs from time to time... you will need one. You may not think you want to do that now... but trust me.... you will. It's a addiction.