undefined | Better HN

0 pointscapableweb2y ago0 comments

Maybe they're talking about https://github.com/mlc-ai/mlc-llm which is used for web-llm (https://github.com/mlc-ai/web-llm)? Seems to be using TVM.

0 comments

1 comments · 1 top-level

Yep.

Its very fast on Vulkan, and from what I understand fast on metal, but its not as feature packed as llama.cpp yet.

j / k navigate · click thread line to collapse