That's an egg membrane for sure. Have you seen any yolky substance under the roost bars or around the coop? In the nesting boxes? Keep an eye on your ladies. Most of the time they are fine after laying a weird egg, but there's always a small chance they can develop an infection due to material being left behind in their reproductive tract.