Yes, this is my experience. Many off the shelf models still don't work, but several of my own models work great as long as they don't use unsupported operators.

You'd think it would fall back to GPU/CPU for unsupported operations instead of failing, but I guess thats easier said than done.

That's been my experience. However when fallback to CPU happens, it sometimes end up making a specific graph execution slower. But that's explicitly mentioned by the warning and pretty much expected.