It may seem that way to a white dude (I'm a white dude, and I suffered from the delusion that tech communities were inclusive for decades), surrounded by white dudes. You're not alone...lots of people think tech is inclusive. I always assumed that our communities were more welcoming than usual, despite the evidence to the contrary in the form of such low historic participation by women and people of color in tech.
But, I've been told it is true from enough women and people of color that I believe it to be true. It's been discussed at great lengths by women and people of color on blogs, on mailing lists, on twitter, etc. I'm not sure what it would take to convince you, but I probably don't have the words to do it, so I'm not gonna try.
For people who acknowledge that our communities do not have a history of being inclusive, it is probably useful to post a CoC in order to signal that we are aware of that history of sexism and racism and acknowledge our willingness to take responsibility for it when it happens in communities we manage, if even in a small way.