Yes, as long as they have plenty of food and water and are protected (i.e., from the family dog or whatever) they should be fine while you're at work. I've now raised several batches of babies and they're a lot hardier than I expected! I raise them in hot hot Texas, and use almost no supplemental heat, but I always give them a heat lamp at night for the first week. I have:
Forgotten to turn the lamp on at night = chicks were fine.
Forgotten to turn it off in the heat of the day = chicks were fine.
Left older babies in an outdoor brooder during a surprise thunderstorm (at night) = chicks were fine.
Left them alone for 14 hours at a stretch when I had to work extra long days = chicks were fine.
I'm not really as bad a mama as I sound, but you know, things happen, and so far, they've been extremely resilient. More than I expected. It's worth noting, though, that we have a really forgiving climate. YMMV.