I strongly disagree with this and I think it runs counter to human nature. You're looking at quality of life as if there were some kind of absolute measure of it, but it really doesn't work like that. Quality of life is always measured relative to the people around us or to whom we are exposed in media or social media.
If you look at modern Americans they have fabulously lavish quality of life in comparison to 19th century factory workers or 11th century peasants. Even people in the poorest quintile have access to safety, food, housing and entertainment that would have made people from centuries past gasp in awe. Antibiotics! Virtual reality! Same day shipping!
But what really counts is how we perceive we are doing versus people we can compare ourselves to. That's where the suffering comes from. You have running hot water but your neighbor has a spa tub. You have the iPhone 6 but a friend just got the 12. You have a safe job that pays your bills but a classmate vacations in Portugal. I've been in other countries where the average quality of life was much lower than the US, and no one knew the difference or had any shame or sadness in their smaller cars, smaller bathrooms or lower square footage.
If there were trillionaires but they all lived on Mars or some faraway continent and we knew nothing about them then they wouldn't cause us social suffering.