I'd put money on them having had an encounter with a predator. I've watched my chickens react to potential predators -- birds flying over, our dog, our cat, ridiculously loud boats, etc. and they are surprisingly good at being still and watching, alerting each other to potential threats, and finding safe places to hide. The behavior you're describing sounds exactly like that.