Some of this is due to tax policy, at least in the US. If you own an oversized house that you’ve had for long enough, then most of the value is a capital gain. If you sell it, you pay taxes on all but $500k of that gain, even if you promptly buy a new, smaller house that costs almost as much. If, instead, you hold the house until you die, the tax is waived completely.
California has additional perverse incentives due to property taxes.