I was looking into it a bit more, and apparently the chalaza is more visible the fresher the egg. Usually we end up with a bit of a backlog of eggs, so maybe that's why I haven't noticed it .
It makes sense that something like this would be in the eggs, but I've never noticed that in mine. Super weird! I'll have to pay attention once they start laying again.