I knock the nests down too, not always at night but I’m not allergic to the stings. People that are have to be more careful. I don’t find the wasps dangerous to the chickens, but I don’t like fooling around in there when wasps are around. They can hurt me!
A quick story. When we had 2 week old chicks in the brooder in the coop, my wife stunned a red wasp and dropped it in the brooder. It was a blast watching the chicks play keep away until they finally ate it. They pecked it to pieces to get sizes they could swallow.
I can just see the little chicks having a ball!