I disagree with your mocking of this. Your emergency fund or retirement savings are not buckets where you throw every last dollar you have. They only cover your emergency fund (typically 3 - 6 months of expenses) and your retirement (10% - 20% of your annual income per year).
For people working a full-time tech job before starting their own venture, I think eschewing those to "invest in yourself" is probably a stupid idea. Not having an emergency fund is a stupid thing to do if you have the financial situation to fund it.
It's a little different for college dropout or straight-out-of-college entrepreneurship. But in that case, pushing off retirement savings until you have a stable job is reasonable, and try your hardest to build up your emergency fund.
Cover your bases. If you're in a high-risk high-reward lifestyle (like tech entrepreneurship), investing 10% - 20% of your income in standard low-fee ETF's is a GREAT point of diversification.