If you replace "Nazi" with another word starting with N, you sound like a person from not too long ago talking about legal status and human rights as well. This has nothing to do with Nazis, it's a question of principle. Principles don't special case particular targets, they either stand or not. Substituting a different target certainly makes you sound like those you're railing against in the first place. Nazis are just an easy target.
> What you describe is functionally the tacit endorsement of abhorrent views. Every moment of every day is political; act like it or don't, but you can't change that it is true.
This is the root of the polarization that is tearing everything apart. The only life you'd be happy to live is one where you're only surrounded by those who are not "politically" divergent from you? Politicizing everything puts you at a fundamentalist war with everything.
This is demonstrably anti-freedom, and intolerance of the existence of differences. Sure, you can promote destroying differences that you don't like (I was going to say "political differences", but that's moot according to your outlook of all differences being political), but you're really speaking against fundamental tenets of western society so it becomes functionally moot.