Probably because once you get away from the coasts, you realize that a lot of people with second homes are not what you'd typically think of as wealthy. Around here a second home is often a cabin "Up North" or a trailer home on a few acres where you go hunting a few times a year or spend weekends. Something your average electrician or plumber can afford.
Good luck to any politician that goes up against that!