https://en.wikipedia.org/wiki/Firstborn_hypothesis https://en.wikipedia.org/wiki/Formation_and_evolution_of_the... https://en.wikipedia.org/wiki/Nebular_hypothesis https://en.wikipedia.org/wiki/Protoplanetary_disk
Now you could still say that surely there have been enough time for some advanced civilizations to form. And I would argue that we don't know that. At least we have not detected them, either due our instruments or unwillingness of the intelligent life to communicate to us.
There are of course many other explanations of the Fermi Paradox. But since its all unknown, its basically pick and choose. I choose to pick the nice option. There are however other nice options :) https://en.wikipedia.org/wiki/Fermi_paradox#Hypothetical_exp...
Maybe intelligence isn't always a product of evolution. Even here on Earth, in the, what, 4 billion years history of the planet, humans are the only evolved creatures with intelligence as defined here. Maybe intelligence doesn't always occur.
A lengthy tangentially related post on my blog if you care -
https://www.rxjourney.net/extraterrestrial-intelligence-and-...
It is unlikely that other beings becoming intelligent enough to rival us and deny us the supremacy over the planet would ever be allowed. Homo sapiens are believed to have "contributed to" the extinction of several other modern-human-like species (one of them being the Neanderthals). How many other times before could something similar have happened, perhaps far earlier in the evolutionary timeline?
The only way we would allow sufficiently highly intelligent life to develop and flourish is if it is completely subservient to us.