Geese are the watch dogs of the poultry world. They're even better at it than most actual watchdogs. Short of fencing them where they cannot see your movements there's not much you can do about it.
Mine will make a little noise even if they can't see me. The squeak of the door to the chicken coop alerts them that I am out and they come to the front of their fence looking for me. Gotta love em!