Something else that holds down weeds and holds in moisture is heavy layers of newspaper. Decomposes nicely into the soil as well.
I use this too, but to keep it from blowing around I put some rocks/sand/gravel on top. Just enough to hold the paper in place.