This is why most people don't get to work from home. Spending time with your kid and being constantly relaxed, working from bed, is counter to the serious business culture of most companies. Don't take this the wrong way, and it's not a dig, but from the way that you wrote that, it sounds like you only work a few hours a day casually.
I can see why Big Bank X would not allow their employees to do that.