Lice don't live long away from their host, so it's most important to treat the birds themselves.
If it were mites, they can live in the bedding of the coop - and i think the wood that the coop is made from.
If it were mites, they can live in the bedding of the coop - and i think the wood that the coop is made from.