What we always do with european wasps is to put petrol down the hole, and then block it off with a bottle stuck upside down.
It fumigates them pretty fast, but I don't know if you would want to do that near a chicken coop.
Permethrin would be well worth a go, it is very light and dusty, so might...