Dehorned dairy wethers are the best, and very cheap and readily available starting in a month. Any sale barn near you will have bottle babies soon, or if you put out a CL ad "Companion goat wanted, good home for dairy wether" you should get some phone calls pretty much no matter where you live.
Like many, when my mare was an only horse, she adopted my goat herd and is still fond of them, even though she now has a foal of her own.
Disbudded goats are totally the way to go. Remember - they call it an accident because no one means for it to happen. So better safe than sorry. Boer goats are an exception, since they've been selectively bred to have horns that sweep back and are much safer. And not just for you (I had my nose pierced by an accidental horn jab - I don't recommend the experience) and the horse, but also the goat itself - I have had several get their horns stuck in fence and one trapped herself in a bucket in a weird way you wouldn't imagine and I can't describe, and now I don't buy goats with horns, no matter what or why.
Also, it is possible to keep just one goat as a pet, but you have to give it as much attention as a dog and it's just not feasible for most. My first goat was an only goat and she was very happy, but she got a LOT of attention and several daily walks with the dogs and the kiddo snuck her into the house to watch cartoons more than once.