Three weeks is old enough for chicks to be mingling with the adult flock. But it would be safer if you had a "panic room" for them in case of a sudden bully attack. Maybe you could modify the 'maternity ward' by cutting 5 x 7 entrances into it.
I utilize a panic room from age three weeks until...