It depends on your location.
In Georgia you can sell fruits and vegetables without a permit as long as you don't process it in any way. (For example, you can't cut it up.)
To sell eggs, however, you need to take a class on candling and grading, and pass an exam.
Most of this information is...