My geese like my goats, I'm not sure if the sentiment is reciprocated. You could try bonding some goslings to them, and see how it goes.I was told a goose is a good companion but I don't believe it either..
If you still get rid of Ozzy and get another female you probably will still see some butting between them. If you let Fancy raise some kids they will bond tightly and you don't see as much of the aggressive like you do between unrelated pairs.
So it's best to keep a mom and her kids or siblings for a more harmonious goat herd.