As far as I understand it you mostly don't see it because once a thread gets to the top it is receiving a net positive stream of incoming vote and since it is already at the top it will receive more votes that threads further down the page.

Sometimes threads are detached by admins and end up at the bottom of the page. In those cases they are usually (possibly always) clearly marked as such.