Synthetic fertilizer should not be applied to areas where chickens will roam. Chemicals may be absorbed either by contact or ingestion.
A chicken that does eat a few pellets will likely be completely fine.
Find out exactly what fertilizer was used and get manufacturer input fir animal safety. Odds are it will be ok after some time especially after a few substantial rainfalls.