Are you saying we shouldn't engage in this kind of reasoning because of the words used to describe it? Shouldn't reasoning be used based on its ability to model the world accurately?
If the above reasoning is prejudice, does that make prejudice a good thing?