I've seen toothpastes sold for dogs. That would probably be safe for other animals too, although I don't know whether the goats would like the flavor.
You could start with just a toothbrush and water. That is sure to be safe, and it keeps things simple while you're starting out. Just the...