You cannot estimate abundance by atomic number like that. The big bang produced mostly hydrogen and helium, with traces of lithium and beryllium. The elements heavier than that are mostly produced by stars, and the physics of fusion have a massive impact on what elements, specifically, get made. Free protons join together to become helium-4 much more readily than any other fusion process, meaning that by the time heavier things start forming, the raw material is entirely ⁴He.
This means that things that are easily made of ⁴He are dramatically more common than anything else, making the most common isotopes after ⁴He oxygen-16 (4 alphas), carbon-12 (3 alphas, less common than oxygen because it's less stable and easily picks up another alpha), neon-20 (5 alphas), and iron-56 (14 alphas to nickel-56 which immediately decays twice through β+ to produce ⁵⁶Fe). Iron is so high up above all the other intermediate steps, because it's the last stop: In heavy enough stars, the entire core converts to iron, and reactions past that are energy-consuming, not energy-producing, so after that the star collapses.
Lithium is not on any of the major stellar nucleosynthesis pathways, which means it's only produced by exceptional processes, making it roughly as universally abundant as the other stuff that is made by exceptional processes, like scandium or gallium or zirconium. But none of that matters, because:
Lithium is abundant and easy to extract in the earth's crust.
While there's not that much of it up there, there's plenty easy to extract down here, because it's so light and likes forming light compounds, meaning that a huge proportion of all the lithium of all the rocks that came together to form the earth is reachable to us. Lithium is not rare. Any statement about lithium batteries that bemoans the scarcity of lithium is doubly confused: Firstly, because lithium is simply not scarce. Secondly, because lithium is such a tiny portion of the battery, that despite being in the name, only a small fraction of the materials cost is lithium.
Lithium price has had a few big spikes because mining is a very high-capital industry where spinning up projects is measured in years, if not decades, and we suddenly started using a lot more lithium in ~2010. Accordingly, the price has spiked from the ~$5k per ton (which is roughly in the same ballpark typical cost of extraction, where any abundant mineral prices end up at), to the heights of $37k per ton last year. Even at this high price, lithium was not even the most expensive material component in most lithium batteries, because typically only 1-3% of the battery's weight is lithium.
But these prices won't last, because having the price of a commodity so high above the cost of extraction means that new mining projects are spinning up.