2MLC LLM: 70B Llama-2-4bit on MacBook at 50%-80% speed of A100 (opens in new tab)twitter.com12junrushao19942y ago3
3Running RedPajama and other open LLMs on phones, browsers and AMD/NV/Intel GPUs (opens in new tab)mlc.ai11junrushao19942y ago0
4MLC: Bringing Hardware Accelerated Language Models to Consumer Devices (opens in new tab)mlc.ai8junrushao19943y ago0
