Oh and if you are keeping it that clean, I can't imagine what smells the neighbor is complaining about? Maybe their imagination is taking over? If you are allowed to keep chickens, I wouldn't worry. I might talk to the neighbor if I knew them enough to do so otherwise it's just neighborhood hearsay.
You could keep them in their coop until a bit later and let them out when the noise wouldn't be as bothersome. If you cannot physically do it due to work, I recommend an auto door. Love mine.
Also, I remember thinking what did I get myself into when I first got chickens, but they really grow on...