> I wonder if at any point browsers will offer a low level accessibility API for you to manually describe components
Accessibility Object Model:
https://wicg.github.io/aom/spec/
It's very slowly coming together, but it won't be rone for many years yet. Especially since what you want is Phase 3.