Contemplate what proportion of those moments are related to work and money, and contemplate how much those issues permeate the rest of your life to the point where they impede your enjoyment of other facets of life.
I made a conscious decision to work from home and comfortable places because I realized that commuting two hours a day was destroying my health. Very few projects would be worth that sacrifice to me (although I realize that many are out there).
I made a choice to eat mindfully and properly in every meal unless I have something else of extreme urgency. I find very few things are worth interrupting a meal. There's at least one hour of every day you can enjoy tremendously, and many people lose complete sight of that.
I am not disagreeing with your premise, but the truth is that most people's desires, in my opinion, seem to be highly misplaced, given that not many people out there are actually working towards a goal so noble that it's worth the rest of the sacrifices in their lives. Having shorter vacations, less time for relaxation and pursuing hobbies is worth it if you're engaged on projects that give tremendous satisfaction and make a difference.