How warm is it at night, and can you provide a heat source in their coop? If it's cooler than 50 degrees, and you can't get a heat source out in the coop, I'd keep them in until they were about 6 weeks. You want them to have feathers all over their backs, bellies, and necks before leaving them without a heat source on chilly nights.