You're not spending enough time on your start up AND you're not spending enough time with your family. You're losing on both counts but you will only realize this in ten years.
What's the rush? Couldn't you have accepted a job at a big company for a few years while you plan a start up once your kids are a bit older?