Yes, the eggs start out small.
As the hen gets older, her eggs will get bigger. With White Leghorns (the very best egg producing breed of chicken) the eggs should get normal sized very quickly, probably in less than a month. If you have a different color variety of Leghorn you may need to...