To be the devil's advocate, many things are a lot more offensive if you swap words of gender with race.
"Birth control for blacks", "we need more jews in STEM", "no blacks in the whites only bathroom".
They're more offensive because unlike race there are very real and relevant biological differences when it comes to gender. And whether or not that applies to STEM probably shapes your viewpoints on this subject.