My vet disagrees with that. Chicks need fine grit. If they eat shavings or straw or something, you'll be sorry you didn't give grit. I ended up with a chick with a sour crop. The chick ended up fine after two weeks of ACV, Grit and mineral oil.
I'm sure many chicks can be fine without it but I wouldn't take the chance again.