> Makes me wonder if there's a missing format out there that should be built into browsers that describes shapes and connections.

https://developer.mozilla.org/en-US/docs/Web/SVG