We don't have sufficient birth rates to maintain things and so both economic productivity but also the tax base will be significantly harmed without this immigration.
That's not to disagree with your comment, the large amounts of immigration do cause problems and as you say, much of it flows into certain cities.