From what I have read, they need a water container that they can actually dunk their head in, but otherwise no. I have two buckets I use alternately for carrying chicken feed, and figured the shorter, wider one could easily be a goose water bucket.
I am almost positive I have something they could use. Heeheehee. I bet they'd look pretty running around with the ducks and the chickens.