Wow, from one annoying goat to horses. You have some homework to do. Horses are $$$$, buying the horse itself is the cheapest part. Horses do better in groups as well, just like goats, the only difference? A goat will let you know vocally it is lonely, while a horse will only whinny a few times or break through a fence.
Please, please, please(!!!) do your homework! Horses are very finicky eaters, there are 300+ types of colic and it is the leading cause to horse deaths. Horses need vaccines, deworming, hoof maintenance(every few weeks!), training, dental work, and tend to be a little more accident prone than goats. The silliest things can go wrong with horses, you know those T-posts people use for fence? Horses kill themselves by impaling themselves on those poles. Horses with halters left on them can break legs and strangle themselves.
You know that saying "Healthy as a horse" BIGGEST misconception ever concieved! LOL