However, it's important to keep in mind that the cost of living in San Francisco or New York is much higher than average. Median rent for a one-bedroom apartment is $2,795 [2] in San Francisco, that alone is over $33k a year. The SF cost of living index is 161.3 and the Manhattan cost of living index is 223.9. In other words, $100k in Manhattan is equivalent to about $45k in an average place in the US, firmly in the middle quintile. The Living Wage Project suggests it takes at least $100k to be effectively middle class in New York [3].
It's really not a perception thing, it's reality.
1: US Census 2011 Household Income Table HINC-05
2: http://priceonomics.com/the-san-francisco-rent-explosion/
3: http://www.huffingtonpost.com/2012/01/27/cities-high-cost-of...