The more cold-blooded breeds are easy keepers and do not require so much feed. Some ponies about live on air - you cannot feed too much or their feet will founder.
The big expense with horses is always the unexpected vet bills - also more lkely with hot-blooded animals like Thoroughbreds...