I put it down to chickens not liking change. They are prey animals, which means lots of different things like to eat them so they are very cautious around anything they don't understand. One example is that when I'm carrying a feed or water bucket which they see a lot they aren't bothered. If I set that bucket down and pull a small camera out of my pocket they get very nervous and move away giving an "I'm nervous" sound. They are not used to seeing that camera. So if you are "different" it can make them nervous.
I haven't experienced this one but several people on here say they have. A rooster attacks them out of the blue. He's been fine forever but all of a sudden he isn't. This is the first time they may have worn bright red boots to take care of the chickens instead of their regular dull green boots. If they switch back to the dull green, no more attacks. Or it is a certain piece of clothing, just something different. They can tell colors.
I don't know what you normally wear. Pants or shorts instead of a flapping dress? Maybe different colors. But yes, what you were wearing probably did have an effect on your chickens. Eventually they can get used to it.
