If they have made their nest some where easy to remove. I would cut out a larger section of wood and move it to the other end of the yard, at night of course!
We had them make a colony in the trunk of an almost dead apple tree in the driveway (don't ask-lol) The neighbor loves her big bees and pleaded with me to not cut the dead parts off (so we could park 2 cars in the driveway) Thankfully, nature took it's course and the tree fell in the night, no cars in the driveway at the time thankfully.
I have a couple that live in the wood of a bird house my son made. One of these nights I am going to bag it up and bring it over to her house.