Shameless plug, this is what https://github.com/cpuguy83/tarfs does.
Granted, you do have to traverse the entire tarball.
> Granted, you do have to traverse the entire tarball.
So you can't randomly access a tarball, you can cache the linear access you've already done.