There are certain types of communication that are vastly superior to do in person that can get quite tedious over text or phone. A 2 minute quick talk can save tons of time.
Now if my colleague is working from home I get the that same disadvantage from working from home - even when I'm still in the office. Many of the downsides people list here with working from home will be shared by those who are still in the office.