If a city waves taxes for Amazon, they'll still have increased costs - say, increased road maintenance around HQ2 as those roads get used much more. Those costs still need to be paid for, and the burden will then move to smaller companies with less clout to negotiate a special deal.
Trying to get an ever-increasing amount of money out of people and organizations with less ability to pay that amount of money seems bottomish for me.