I agree with duckiemum about blocking off the under-coop space.
It doesn't have to be forever, just until you're sure they put themselves in at night. You might be able to use cardboard or chicken wire, because it does not need to be predator proof or long-lasting.