Yes the auto waterers need cleaned out too. Mine get the usual dirt from the hens drinking and will also grow a thin layer of algae, barely noticeable until you go to clean it out and realize there is a thin film there.
It doesn't take much to clean them out. The bowl is attached to the valve...