But is the Internet really as centralized as Email has become? I was living under the impression that Internet backbone providers where more diversified than that.
With BGP, you are usually only peering with a couple entities unless you are yourself in the "big boys club". It's a relationship business, but you only need a relationship with the handful of engineers who are on the other side of your own links.
