And people wonder why we don't pull kids to bottle feed!
Generally you wean off the bottle from 8-12 weeks of age - you're almost done! Fret not, the booger WILL eat hay/pellets when he gets hungry. Not having another goat to teach them to eat makes it take longer...but he WILL get hungry!