No oyster shells until they start to lay.
It is safe to put it out before they start laying. But it needs to be in a separate container, not mixed with anything else.
That way the layers can eat it, and the others can ignore it. (They may taste a little bit to learn what it is, but won't eat enough to be harmful.)