What needs to happen is effort put in to make other cities and towns attractive. This could mean encouraging commerce and industry to re-locate or set up new factories or offices. It certainly means ensuring city-level standards of health care and education, something that is a good thing to do anyway
Lastly there needs to be a campaign to encourage people to move to these places. Australia already has migration programs that require people to live anywhere other than the main capital cities.
Australia has a scarcity of fresh water, and low rainfall. Our inland rivers are dying because water is diverted to irrigation for farming; Sydney's water supply is pretty stretched and the option to build more dams is neither environmentally desirable nor possible, because all the rivers have already been dammed, and most are less than full due to low rainfall.
So without resorting to calling NIMBY, at what point can we say "we cannot support any more people"?