Thanks everyone for answering!
UPDATE:
Woke up to hear them all peeping. I have them all in a old guinea pig cage, put in some hay, bedding (to make it like a nest) and she's messed around with everything to make it "perfect".
On one corner we have the water.
Right now we're using regular chicken food, but I'm going out today to get some chicken starter. Meanwhile, I noticed the mama is getting the regular chicken food, pecking it in half, and handing a smaller piece to each chick. She's breaking it up for them.. or at least that's what I think she's doing lol
She doesn't mind me watching as long as I don't reach my hand in or tower above her. So I have to sit down quietly and watch, which is not so bad.
They ate a bit, but she doesn't seem interested in her water yet. She hasn't touched it. I guess that will take time but she looks way better than yesterday: much dryer and happier looking, less stressed out than last night.
Her chicks are just adorable! (They're bantam chicks and super tiny, like little golf balls). I will post pics SOON!
Oh and real quick: Should I let her out of the nest at all to exercise outside? Or would a mother hen stay in her nest at all times? We don't want her flying around in the house but it seems cruel to keep her in the cage, even though she's a super small bantam and doesn't seem to mind.. but should she be let out to fly around a bit or get some air and then come back? Advice please?