I remember issues when they changed their caching mechanism, or when a couple of libraries I was using were importing internal stuff from pip which got changed in a new version.
Also some packages for some reason need to be installed in the correct order and it's not immediately clear until pip tweaks their installation procedure.