If they are remanants in people's DNA, they did become common ancestors, no? Everyone's family tree collapses to the same individuals at 5500 BC, after the other humans went extinct.(1) That means we are all descended from non Homo Sapiens humans. What I'm trying to say is that they were not "purged," we are their descendants. We got most of our genetic material from the Homo Sapiens side, but there is continuity with the other species as well.

(1) https://www.scientificamerican.com/article/humans-are-all-mo...