Your coop is really nice! Love the colors, etc.
Lots is thoughts above. Yes, chickens themselves are dusty! They create dust even when growing feathers. But most animals shed something and are therefore dusty, like humans who shed dead skin cells. So we sweep, swiffer, mop, and vacuum. Maybe part of the daily or weekly chores are to wipe down walls, and wash the curtains on a certain routine.
The number of chickens also matter here. Not sure what numbers you have, but it doesn’t look like you have a lot of them bc the coop (and walls) would be dirtier I think.
You can wash chickens, however, it’s not something to do a lot. But, your white chickens are coffee colored, so it might be worth a bath once you switch. I typically use a very mild and unscented dish soap that is low sudsing. I’ve bought the last one from
Walmart baby aisle -for washing baby bottles. A bin of warm-ish water, add soap, swish it around, add chicken and hold firmly bc they will likely try to escape this new and frightening experience. I keep their head and neck out of the water. I will gently swish and lightly scrub with one hand (other holding chicken at all times), under wings, between legs, legs and feet too. If they need something washed off near/on head be very careful to avoid eyes and nose. If they are very desperate, they may have already dunked their head, but do your best to keep their head out of the water. Next place into bin of rinse water. Lightly rub with fingers and rinse. This is where low sudsing soap is handy- there is less difficulty to get a good rinse. Remove and wrap in towel. Press the towel to them to sop up water -don’t rub with the towel. Now use a hair dryer to dry them off-focus on their under feathers, under their wings and bottom fluff. They LIKE the hair dryer! Dry them very well if it’s cold outside, but if it’s warm then drying their under feathers well is just fine.
Regarding clay/non clumping litter, I believe it isn’t good for them bc the clay may cause issues as they eat it and they will eat it, some more than others. I wouldn’t get scented bc birds and poultry have sensitive respiratory tracks.
In your situation, I would clean more regularly. I’ve heard of people using shredded paper too, but no matter what, the poop will get on the litter and dry. The dried poop gets scratched around by chickens doing chicken behavior, and this also creates dust. So, it’s just something to manage.
Good luck.