To be clear, you're comparing anti-semites (a racist "group") with Jews (an ethnic/religious group). One is defined by holding a targeted, hateful ideology. The other is a group of human beings, by birth/existence.
I make no claim against you, but this framing represents the insidiously successful repackaging of hate as an "equal right", which racists have used to mainstream hateful ideas that, at-scale, ultimately infringe on the rights of groups of people. This can include (has included) incitement to violence. The latter is famously a limitation of free speech, and all rights are generally circumscribed by their infringement on the rights of others, in any case.
The other insidiously misleading argument around this issue is that Twitter is enforcing "free speech" in the first place. Only the government can infringe on the right, as it restrains only the government. Twitter is no "protector" of free speech, because it cannot be. It can, however, make the choice to allow and promote hateful speech against others, and that's exactly what it's doing.
So, the argument here is not whether promoting rights is good for society. The argument is whether promoting hate is good for society.