Because the processes and mindset won't be setup for it. Decisions will get made in hallway conversations or even in meetings in which no one thought to send out a phone number for the remote employee to attend.

Hence the idea that remote working is probably most effective when companies treat it as the norm--at least on a group by group basis.