Its not the entire world, mostly the US. Japan for example doesnt have a NIMBY problem and that has allowed tokyo to become incredibly dense without becoming expensive.
Where do you live? Even manhattan has vacancy rates barely above the 3% structural minimum and thats the poster child for "rich people leaving property vacant" complaints.
The problem really is that too many homeowners refuse to allow anything other than SFHs to be built near them.
