The family will claim to understand that you have to work, sometimes (often?) uninterrupted. But the perception, especially for children, is that you are there; just not participating.

This segues into to the other point I found pertinent - everyone being remote is definitely better. This is currently how I work, but I was previously a "minority" remote worker. Depending on the organisation, there is a whole political architecture that others navigate/recruit, but that you cannot access to the same degree. It doesn't matter how good you are, you can be undermined by people who resent advice/change/correction/omission/etc. This contributes its own stress.