They do not need anything to eat or drink for two days, as they absorbed the yolk sac and are fine.
But you can place a little dish or small shallow bowl with chick starter, millet and some little pieces of scrambled egg inside the box right in front of the broody if it makes you feel better...