I don't think you took them out too early. My hens have their babies out at day two. The chicks I've brooded myself have been raised in the coop and were allowed on grass their 1st week.
Try a small temporary fenced area for them. Tall enough to keep them in but low enough so that you can reach...