There's a straight line between that argument - which again, almost always gets through around with out any kind of citations or research support - and ethnic cleansing. It's directly attached to racist ideas. Similar to social darwinism, it's something that seems like relatively harmless common sense on the surface, but leads to horrific implications when followed to its logical conclusion.