It is one definition, but there are other more abstract definitions that mean "an unjust exertion of force or power", "rough or immoderate vehemence, as of feeling or language", "damage through distortion", etc.

For example, the phrase "violent scolding" is stuck in my mind from a fairy tale I read as a child, and indeed, if you search Google Books for that phrase, you'll see many examples dating back to at least the 1800s, examples that do not mean physical violence.

So, I don't think it's some new redefinition of violence to use it more abstractly. I think of it similar to the term abuse. Sure, abuse often means a physical act, but it often means verbal/emotional acts.