You could trap them, but then what? If you release them, they can come back or they can cause problems or die if relocated to a totally new area.
If they're ground squirrels, it's possible that you can bury your fence a little or put some kind of wire or covering on the ground that they...