Yes you are right about NYC, and the same is true in Boston - it's been explained repeatedly in this thread why the broker fee is not at all equivalent to a landlord giving up that money, but for some reason there are commenters that just keep repeating the same line about a perfectly rational market instead of engaging with the actual arguments presented.

For someone new to the market it is essentially a hidden fee you find out about at buy time. Since 90% of places do this it would be a huge hassle for a tenant to try to avoid the fee, especially with the pressures surrounding shopping for housing. It's not the same at all as changing a list price.