Sounds like they are sticking close to you, maybe they know your their protection. When my rooster sounds the alarm my birds always run to the back gate like they know it’s close to us.
I’d def say something is making them nervous. A game camera would tell you a lot. Do you have a secure pen for your birds? I’d suggest keeping them up till you figure out what’s going on.