The underlying premise being that they're moving to this place from some other place. But that has an obvious solution: Build more housing everywhere. People can't increase the population of everywhere by moving from everywhere to everywhere.
It also implies that building it in one place still helps to reduce the cost somewhere else. If you make San Jose more attractive and people move from San Francisco to San Jose then you're reducing demand in San Francisco and lowering the prices there.
> Obviously there's a logical limit to the argument- things get weird when you build more housing than there are people- but then so too do the logistical issues of sewer, water, electricity, and geology (some locations simply aren't economical to build high rise buildings on).
The constraints at the physical limit are irrelevant because you don't need to get anywhere close to it. The point is that you could if you had to, not that you actually have to.