I can understand that he wants to make a distinction between aggressive word usage, and non-aggressive. But calling it "violence" is hyperbolic, and dangerous to free speech.
Threats of and exhortations to violence are universally considered unprotected by free speech. So people who dislike other peoples speech have an incentive to call it "violence".