> Tbf many of those restrictions are there for good city planning reasons - and important to keeping a city livable and not outgrowing its infrastructure.
I don't believe this to be true. If someone wants to build a single multi-story building in an area, no additional infrastructure should be required. It's one building, the existing infrastructure shouldn't have so little slack in it that this could be a problem.
If lots of people are building lots of buildings, the city government can notice this taking place and while the buildings are going up they expand the capacity of the infrastructure in that area. It's no excuse to refuse the construction, it's just something the city has to do as a result, because that is a city's job.
Their job is not to decide what can be built, it's to allocate the property tax on the new buildings to paying for the things the new buildings need.