That's a good reason to rid them. I'd spray them up in their retreats with Orange Guard, remove the webs the next day with a stick in order to gather up all the silk and then check again in a couple days. By gathering up the silk you'll be able to know which ones survived the first spray--any new silk means survivors--and you'll be more likely to collect up any surviving egg sacs. A strong shop-vac also works well at pulling them out.
Have you ever been to the Second Street School? It's at 2nd and Tucson Blvd. My daughter went to day care/preschool there. While it is an absolutely amazing place for many reasons, her very favorite part was the chickens they raised. Because of that, I had to answer the question, "When are we getting chickens, Dad?" for years. It makes me wonder if those kids that went through there will be more likely to raise chickens as adults.