Source: https://en.wikipedia.org/wiki/Carpenter_bee#Ecological_signi...
Im not really too worried about being stung by them, and I agree they generally dont want to mess with you unless you are actively messing with their burrow. I have taken to putting out sacrificial 2x4s each season that I pre-drill(3/4" holes seem to do the trick) to attract the bees to easier pickings. This helps quite a bit, but I still have to end up spraying a few holes in our siding and deck each year as it will soon be swiss cheese if I do not...
I was amazed to see that the male kept returning to the same spot for what seemed like weeks looking for its partner in the now relocated piece of driftwood. I naively had expected it to track down the piece of driftwood just 40 ft away in the front yard, and it was kind of heartbreaking to see it searching for it in desperation.