I do not recommend getting a buck and a doe, because you will need to keep them separated, and goats are herd animals, so they won't like being alone. Pygmies are year round breeders. Which means if you keep them together, he can impregnate her as soon as she has her first heat (far too young for a healthy pregnancy). Then, as soon as she kids, impregnate her again. Then again, and again. It is a disastrous cycle that will destroy her health.
For a beginner, I'd recommend getting two does, or a wether (an neutered buck) and a doe. There might be someone in the area who does pygmy stud service, so you don't need to keep a buck if you want any girls bred.