I entirely see AndrewKemendo's point. But yes, you see my position correctly. In fact, I would argue that Altman, Andreesen, PG, et al. are not even "trying to build $1BN+ companies". They are investing their money in High Yield High Risk markets. And their track records and returns show this. They have funded 716 companies. 3 are worth north of $1BN. 20 are greater than $100M. [1] Their track record is amazing, but ~97% of the business's they have invested in have not "made it big", so to speak.
A good friend of mine owns a very successful real estate software company. At last estimate he is worth ~$300M. He started the company without traditional investors (his father did put in $10,000 to be fair), he owns the entire business himself. He has many "things"; cars, vacation homes, an island. He also has a wife and has very successfully raised 4 kids while building up his business.
The point I hope a few people can take away from all of this is that investors like YC and the like have one way of starting a business. It is successful for some, life changing for others, and entirely the wrong approach to business for yet a different group. There are many other ways to start a business, technical or not. grey-area, I am with you. It is not healthy to have a company consume you completely, and it is not necessary for a business to succeed. Work hard, understand your market and most importantly your customers, build a product your customers enjoy and need, and you will find success, possibly the variety that makes you $100M+.
[1] http://blog.ycombinator.com/yc-portfolio-stats