True, although I'd say most users are logged in, so that does make caching much harder.
stackoverflow is just a nice example that you don't need dozens of servers, even when you reach their scale.
I do believe Brook's The Mythical Man-Month does also applies to computers. In that communication overhead soon outweighs the benefits of adding more computer nodes.