I don't think you really understand that "freedom of speech" refers to the actions of the government. It has nothing to do with what private citizens do in response to what you say. The first amendment doesn't protect you from blowback and it's not supposed to. Freedom of speech is not freedom from criticism.
However if you consider freedom of speech an issue between citizens, wouldn't the right to bear arms be the greatest enemy of freedom of speech? Seems like "an armed society is a polite society" is a recipe for a society where nobody speaks their mind for fear of losing their life...