The thing is, self-professed "free speech absolutists" generally believe that only right with and nazi speech are the ones worthy of defense. Anybody else who is criticizing those, disagreeing with those or promoting other ideas is seen as threat to free speech.
Self-professed "free speech absolutists" get really angry when left or anti right people speak or make the right uncomfortable.