Always? Pretty sure that there are also toxic people who just go about their lives without realising how they affect others.
And even if you’re right, there should be some nontoxic people in toxic environments and they should able to talk about it without someone immediately accusing them of being the problem.