Why is all the "wheels", "eggs", "PyPi" ... stuff needed then?
eggs and wheels solve binary distribution between other things, so you can install something that requires compilation without having a compiler or the development libraries installed and to avoid bundling files unnecessary during runtime.
pip _can_ compile the code at install-time if your PC has the right build tools -- or it can download pre-built binaries for your host in the form of a "wheel".
pypi has a little more metadata than a git repo, and a place to host version-controlled binaries.