Exactly the same :) the guilt of not spending time with my kids and my wife is too much. There have been times where I've tried to sit down and work on something but it's no fun when there's a strong feeling of "I should be spending this time with my family".
The other thing I've noticed is that the separation and challenge of raising children has made me more productive. You don't know stress until you've had a newborn. There are things at work that used to affect me and I look back now and think "how was that even a problem?"