Apache TVM is super cool in theory. Its fast thanks to the autotuning, and it supports tons of backends like Vulkan, Metal, WASM + WebGPU, fpgas, weird mobile accelerators and such. It supports quantization, dynamism and other cool features.
But... It isn't used much outside MLC? And MLC's implementations are basically demos.
I dunno why. AI inference communities are dying for fast multiplatform backends without the fuss of PyTorch.
