When we first got goats a few years ago, they were the worst ever . . . It didn't take long for them to climb the fence, and as soon as they find out what chicken food is, ugh!! There's no stopping them. Well, there is, but it takes lots of work when you don't have many resources.
Tethering goats out front is indeed a nice idea, but make sure the line is a rope, and one that can't hurt them too much if they get tangled, and make sure the stake is DEEP in the ground. We tried it with a stake, and it was ripped out in no time, so we moved onto using tree stumps and the sort. But, that ended up a very limited idea, and we simply resorted back to keeping the goats in a fenced pasture.