My comment seemed to be a little too subtle. Let me lay it out:
Our willingness to shame this guy (and other guys, by extension) for spending time with his family reflects our willingness to shame women for taking the same time off.
Our acceptance that he should put work over his family forces SOMEONE to put his family over THEIR work. In a male-female marriage (yes, I know he is gay), this means that men should work and women should stay at home. This attitude contributes to the gender pay divide and stereotypes that men shouldn't be great fathers.
It hurts our wives and our strength as husbands and fathers.