Anti-semites don't see things that way. They see Jewish people as attacking THEM, denying THEM the right to their way of existence. They might use the same language you use.
You bring up an important point, implementing equal rights does not reduce the rights of those who previously were oppressors, no matter how delusional their thinking is.