However you slice it, remote-vs-office is a matter of perspective. Trying to make one uniform office/remote policy is not working.
If you're not sure how to connect with people while working remotely, search for coworking spaces, coliving, and workations, and find an in person meetup for one of your hobbies. I often go to running groups or meet people at the gym.