That could be right. All mine were rescues from different places and times except two who were litter mates according to the shelter.
They were all young cats when I adopted them but not tiny kittens, so my guess is they had a hard life before coming to live with me.
Two of them for sure were massively under weight and were terrified of everything for weeks so I can only imagine they had a rough start, and one of them is terrified specifically of men's voices, and one doesn't cope with people at all (except for me of course).
So I guess I have a house full of feline neuroticism!