I agree with you, people shouldn't be removed, ejected, forced to move, etc from a society based on their race or at all for any matter (though we kinda collectively agreed that that's okay for criminals? Separate discussion I guess.). What is evil is forcing people to do things against their will, period. But people wanting to be in groups similar to them isn't inherently evil, and I think we need to get past that in conversation. E.g. right now I would definitely prefer to be with people I share common nationality, interest, culture with.
I fear we're in dangerous territory where all such distinctions and nuance are lost in the shouting, essentially making us all "evil" in some way or another.