Bees like mineral water when it is hot and will eagerly search out swimming pools because of the chemicals. I have two hives and neighbors with pools, and I put out a small kiddie swimming pool filled with water them dump in a small mineral block (like for cows/horses to lick) and floating hay/grass for the bees to be able to get out of the water. They never bother the neighbors or my chickens. I also use my chickens to help clean out drone brood or old comb, and they will readily eat the larva, brood, and even adult bees that wonder over. Bees can't really sting through all the feathers, so they really shouldn't be too much of a concern to your chickens. I think if you gave the bees their own preferred water source they may leave the regular water alone.