I don't think I would go looking for trouble!
I get along with my neighbors quite well but they are neighbors not friends. They both do things that bug me that I tolerate. The neighbor on one side had 2 barking dogs that I put up with. These guys are never home. I have told them long time...
Surely it would take a complaint from more than one neighbor. How likely is it really, that several unreasonable neighbors band together. If they come to you first point out that they don't make any noise from dusk till dawn, unlike dogs & cats.