That said, I find that full remote works really well. Half-remote is a lot more difficult for the reasons you say, but encouraging all employees to work remote some of the time starts to equalize those issues, because everyone has the empathy of the experience.
I've developed a set of coping strategies, but I agree that it's a tradeoff unless everyone is remote.