Jackson is a resort town, like Vail, Aspen, Sun City, Park City, etc...you are usually really rich if you live there, or doing service jobs for the very rich. Obviously, you can't just move there and expect to somehow survive.
If I had a few billion dollars lying around why not? I'm a big fan of anything on the snake river, having been a toddler in the city where it meets the Columbia. But I need to work for a living, so it will be a big city with a thriving economy for me, I don't have the option of liesuring about in a resort town.