To me, it was not about people leaving you behind, but calling you up when opportunities arise (though I didn't feel that way when it first happened at the beginning of my career). Camaraderie doesn't mean you owe people or are owed anything, but is a mutual level of trust and support.
Of the 6 jobs I've had over the past 20 years, 5 of them have been from former colleagues reaching out.