So about 1-3 ounces each feeding?
Is formula okay? I've heard some people say it's bad for baby goats?
I think you can buy a special formula for baby goats.
I know the internet has several recipes using cow's milk from the store plus a few other ingredients to make a formula for baby goats.
If you have a female goat giving milk, that would be an excellent choice, but it sounds like you might not.
Even though you say the mother has no milk now, I would suggest checking a few times a day for the next week or so. Her milk supply might just be slow to start, and if she does produce milk you might be able to get the baby nursing, or at least milk her and feed the kid. And of course you wouldn't want her getting mastitis, which is more likely when the udder is full of milk and less likely when the kid nurses or the doe gets milked regularly.
And that baby photo is really cute