If you don't want to kill the bees, just persuade them to go elsewhere, there are products that beekeepers use to clear bees from the honey frames before taking them. They are harmless to the bee...
More often than not, these are yellow jackets. Short of flooding the nest with pesticide, a dangerous and not altogether effective way, there is little you can do. If you have a wet/dry vacuum, you...