You could say that the survivors of the Titanic didn't want to drown, sure, but you're selecting for the people who survived. The people who all drowned might have wanted to!

I.e. there's a balance. People basically always migrating in one direction must tell you something other than "those exact people just wanted to".