The only time my birds get bugs is in the winter. They can't dust bathe because everything is frozen solid. They spend more time huddled together for warmth. And they spend more time in the coop out of the wind. That is a recipe for an infestation. You will need to treat the birds for bugs and then re-treat in a week. You don't have to cut out the nits unless they offend you. Some choose to, some don't. All a matter of personal choice. You will also need to treat your coop. That's the biggest pain this time of year with all the bedding frozen to the floor. Hoe the house out completely and spray everything down with an insecticide. Put in new bedding and sprinkle some poultry dust around. Go light on the bedding because the house will need to be cleaned out again in a week.
Does it sound like I've done this before? I have. The past two winters. This year I got a jump on them early before everything froze, so cleaning out the coop wasn't nearly as painful as it's been in the past. I think I am going to institute a plan for preemptive treatment next winter.
Bugs are a pain, but pretty easy to deal with. Good luck.