Water is water. So long as isn't getting moldy or getting algae or whatnot in it, it's fine.
Actually, "stale" water may be better, since chlorine tends to evaporate out after sitting for awhile. Not sure what your water is like, but that may well be what you are tasting in your "fresh"...