But now you're getting into the "free speech for me, not for thee" part. You're basically saying that Damore is entitled to free speech and protection, but that Google and his former co-workers are not. Remember, who you work with is part of the freedom of association which is a component of free speech.
This is a strawman I'm very hard pressed to find anyone in HN at least who would deny Goolgle's right or another other party's right of writing a rebuttal to his claims. A free and open internal debate is exactly what Damore was trying to start. Firing to me at least is not speech, it's an inherently violent act.
It's not a strawman if plenty of people in this comment section are making the exact argument. And if I can't fire an employee for being hostile to my other employees, then I do not have freedom of association.