If the entire team/division/org doesn't fully embrace it, it usually just doesn't work. That doesn't mean everyone had to be remote, either.
I saw a note about everyone headphoning in - I can try this, but am skeptical because those people are still going to be more present than me (I mentioned this in my op). There are going to be side conversations, notes, glances, eye rolls, sighs I miss - the things I definitely need to get the full presence. Not to mention the walkie talkie nature of this - with everyone muting / unmuting and feedbacking.
I am open to other ideas - but am looking for ones that don't make the human interaction a lot more measured and artificial. As much as I like to be Spock, my xp points at emotions driving 90% of real decisions because the logical ones pretty much are a lay up in a sane group.
1. Every meeting should be video first. Going without video should be extraordinarily rare. Even if that's just an impromptu meeting with 2 or 3 people. Kill conference phones completely. Get used to screen sharing. Good reliable tools like Zoom are invaluable. You miss a lot from body language and facial expressions if you use audio only, which will fix your major issue. It also makes people feel more included and that the people working somewhere else are actually real people and not just voices. Make good use of Slack video
2. Every meeting should be able to be taken as remote, even if that means just from your desk (or personal meeting room if you're in an open office). This means that the people who are in a conference room must be on video with an open mic, unless there is uncontrollable excessive background noise or something. No cross the table talk on mute.
3. Don't be afraid to make temp rooms with multiple people when you have conversations on Slack (or whatever you use), it'll help more people get involved as if you were talking at someone's desk.
The first 2 things are extremely important. Invision has recently released some blogs about cultivating a good remote culture that are pretty good. I don't have any links handy, however but it's worth a look if you're interested.