Productivity has gone up so much people can work a lot less, and vast part of the population doesn't work at all.
The 40hr work week didn't come by as a consequence of the profit maximization mentality, but as a consequence of hard fought battles by the workers/employees against that mentality. And when I say "hard fought" I mean in the literal sense, with at least 1,000 workers killed just in the US in those days. https://en.wikipedia.org/wiki/List_of_worker_deaths_in_Unite...
If you still aren't convinced, consider that the benefits package routinely offered to employees is worth around 40% of their pay.
Most people do a lot of work themselves that the Richie Rich would pay somebody else to do, like cooking, cleaning, childcare, gardening, etc. If it counts as work when you hire somebody to do it, it should equally count as work if you do it yourself.
BTW, cooking in those days was an all day affair. The wood stove required continuous feeding and watching. Today one can just put the food in a microwave.
I cook a steak now and then, it's the only cooking I do. It takes about 10 minutes. The dishwasher does the cleaning.
Rich people hire others to do the cooking because the rich peoples' jobs pay off far more per hour of work. For example, if my profession pays me $100/hr, it makes perfect sense to pay someone $30/hr to do the cooking for me, as I am still $70/hr ahead.
Life expectancy and average height improved throughout the 19th century.
