That implies then that there will indeed be weekends where your boss expects you to work, your spouse is working, you cannot, and therefore you “fail”.

Because then he would have to say no to overtime or weekend work once in a while.