> Stuff gets thrown into various orbits. Most of the debris will deorbit quickly, but a small percentage can get a substantial kick and go higher.
Only at apoapsis. But, any item thrown into an orbit with a significantly higher apoapsis will very likely have a significantly lower periapsis. So even for high-energy fragments, each orbit should have a period of passing through a higher-drag part of its orbit, and lose energy relatively quickly.
Significantly, the periapsis can never be lower than the altitude that the collision occurred. The worst case, IIRC, is for fragments ejected in the direction of orbital travel at the time of collision. But even then, they'll still spend some time in whatever drag environment they were in beforehand.
That's not to say collisions are fine, but nothing is going to get thrown into random high low-eccentricity orbits where they hang around and pose a threat for decades or more.