Unfortunately, no, they have likely been poisoned. It doesn't take much to kill a chicken. Petroleum distillates are deadly to chickens, and you will see signs of poisoning between now and morning. The extent of the poisoning depends on how much they ingested, but if they do survive, expect some damage such as lameness, balance issues, and nerve damage.
There is no antidote to petroleum distillate poisoning.
You are not alone. I have lost chickens to insecticide poisoning in my early years of keeping them. It didn't occur to me that my chickens were the perfect means to insect control and I could simply toss out all my cans of insect spray.