The problem with this is that you can’t forcibly reduce population. Halting growth in one area just displaces it. This can be a good trade if the area into which growth is displaced is underdeveloped with few other potential uses. But it can also create Atlanta or Houston style sprawl, or destroy natural areas that would be better to preserve.
Japan is an unusual example because most job opportunities are in a handful of areas. You can get impossibly cheap properties in the countryside but there are few jobs or young people. Properties in the city keep getting more expensive because of demand and because building codes are constantly evolving to keep up with new developments in earthquake protection. There are older urban properties available for cheap outside of trendy areas, but the cost of renovation is often too high to be worth it. There’s also a cultural stigma around older properties.