If your fence won't hold water it won't hold goats as the old folks might say.
I have fencing panels and run 3 strands of electric wire. They learn VERY quickly to respect the electric fence.
Lonely bored goats are are mischevious as well as destructive.
You must ask yourself - are you...