I am all about clean water too but please keep in mind that soap can leave a film on the waterers that isn't good for birds.
The best thing to clean waterers with is white vinegar and a scrub brush. It will kill algae and leave things nice and clean.
I do this for my guinea pigs water and...