Mine go into a fairly big shed at night and are locked in just like my chickens and ducks are locked in coops at night. I would strongly recommend you get some sort of shelter you can close them in at night.
Maybe also put a couple strands of razor barbed wire on top of your goat fencing...