My version of that is that there's a difference between living to work and working to live. It's really up to you, how far you allow your business to encroach on your personal life; it's up to you how much of a workaholic you want to be.
I see my kids every morning, have breakfast with them, and drive them to school. I have dinner with them every night, albeit at 2000, and they're very young. There's a (stereotypical) North American mentality that dinner needs to be early for children, that they can't stay up late, and then there's the rest of the world. Kids can nap for an hour or two around 1630/1700, life won't end.
Call me during dinner time, and you're instantly on voicemail. Employees know it, investors know it, business partners know it. Dinner is sacrosanct, I've literally never missed dinner with family.
Some people will leave you, some people can't work that way- but that doesn't mean your company can't. Sometimes that means losing great talent, there's a shocking amount of the world that (currently) NEED their work to be all consuming. That's okay, it just means my companies aren't for them.
A shocking number of investors actually get this, and respect you for it. There's no need to dance around the 'knowing what you will not bend on' phase - because you're up front. Equally, the approach helps you focus on the time you do have. It helps you maximize the time you're using, because of the need to get what's truly important.
Businesses will come and go. Fortunes will be made and lost (hopefully made!). But you only have X years. If you want to spend them engrossed overarchingly in business, there's nothing wrong with that. If you're like @trcollinson, and others like us, then family is the priority.