Changing it out can work, and is the only method I have any experience with (various waterer styles, but never that exact one.)
I think the cups will freeze long before the rest of the bucket. If the cups are frozen, the chickens cannot get water, no matter how much is in the bucket. Of course...