Anything that differs from the norm is considered 'gross' by a lot of people. Unfortunately. It's the main reason for so many food allergies and sensitivities, we eat too much of one thing!We haven't really noticed any issues in baking. I think it may be the limited amount, but we don't really try it anymore.
I am not sure the intolerance is more common with chickens. There a lot of people who will not even try duck eggs. They think it is gross for some reason. I am not sure how an egg that comes out of a duck butt is any more weird than one that comes out of chicken butt. So a lot of people would never know if they can't eat duck eggs. While chicken eggs are very common. I feel bad for the people who can't eat either, which is very uncommon.
I personally try to eat varied when I can. If the ducks hadn't destroyed my garden, I would have had a good variety of stuff for the winter. *sigh* Next year, fences.