For those that this lifestyle appeals to, it is possible in America to engineer your life so that it happens. Sure the median American is no where close to financial independence, but financial independence is attainable for most Americans given a couple decades of work if they are willing to change their definition of "enough."
Personally, I reduced my target to a mere fraction of the $5 million you mentioned.
Finally, I completely agree that this is privilege, but without any negative judgement therein. Privilege is a thing we should be trying to give to more and more people.