Your tag line says you have 3 pullets so this should be easy. I would temporalily move the girls out of the coop. They could be fine caged for a day or two. Once the girls were out, I would bug bomb the coop. After the coop aired, I would sweep it out to clean up dead bugs. Of course change all of the bedding and wash the feeders and waterers and air everything out.