The problem, as always, is how to make immediate mode stuff work with accessibility tools.

The value of essentially creating and mutating a tree structure like the DOM is that things like screen readers and UI automation tools can read it. With canvas they just see a big bitmap.