That's a pretty bad mindset, new pip versions (20+) include support for binary distributions that saves a lot of time when installing pretty much anything that needs to be compiled.
Just run `pip install --upgrade pip` every month and you will be fine.