Yes, you can inflammatorily impugn the motives of people arguing in favor of any side. That doesn't make the concerns about free speech invalid, it just means you're willing to resort to similar propagandistic tactics.

Edit: rewrite after understanding your point better.