If you told your neighbors that you wouldn't get any roosters and then you keep one, you at least need to talk to them again and explain it. At least that's what I would do.
Yes, I know its your property but to keep the cohesiveness of the neighborhood, I would do it.
I have 9 roosters so...