Start giving grit when you start giving treats that they need it for. They make chick grit and I don't think there is a certain age that they can magically have grit or need grit.
It depends on what they are eating. They don't need it if they are just eating chick starter or the equivalent, but as soon as they have access to grass, etc. they will need it. Offering it can't hurt anything.