Speaking in absolutes is never useful even though I think this advice might apply when looking for a new role, but small companies tend to grow if you help them succeed so it would be difficult to say your fit is at 10 person companies when that means you would have to jump ship every year just to stay in your comfort zone.

I joined my current company when it was 40 people (and around 10 developers). Almost 6 years later we're ~1500 and the engineering org is something like 200-300. I think I was most comfortable around 20 or so developers but that doesn't mean I can't make continue to have meaningful impact now that there's an order of magnitude more people and the org has completely changed.

I've seen folks who were supposedly "A player"s from small start-ups and FAANG join the company at different stages. Some succeed and some fail but I never noticed any correlation between current size of the company they're currently thriving at and our size when they joined.

Fit is never going to be perfect so don't give up on something just because it might be a little uncomfortable. Give up if you've tried to make it work and it's clear you can't find a way to have impact.