Mscory, I was on the fence about pulling them out until I read that they are not just toxic, but lethal in even small amounts.
Here is some info:
"As little as 0.005 percent of an animals body weight of dry leaves may be lethal - as few as 10 to 20 medium-sized leaves may kill an adult horse. It is toxic to all animal species, and many livestock and pets are poisoned, usually because they consumed oleander clippings or dead leaves. The green leaves of the growing shrubs are bitter and are therefore seldom eaten. The wilted clippings and dead leaves remain toxic, are palatable and are readily consumed. Compost containing oleander leaves has also been incriminated in poisoning."
and another:
"Consumption of this highly toxic plant causes cardiac failure. Signs in poisoned animals develop within 4 hours and can include:
Sudden death (no observed clinical signs)
Colic
Weakness
Lack of rumen muscle tone
Salivation
Very fast or slow heart rate
I figured that if I won't drink the milk of a cow who gets injected with hormones, antibiotics and steroids I am certainly not risking the eggs of a chicken with access to oleander. Plus I'm not spending the time and money on some BYCs just to risk killing them with an ornamental plant...
With animals and kids, that was enough for me. We removed the oleander and replaced them with honeysuckle.