1Scaling LLama2-70B with Multiple Nvidia/AMD GPU (opens in new tab)(blog.mlc.ai)13junrushao19942y ago6Save
2MLC LLM: 70B Llama-2-4bit on MacBook at 50%-80% speed of A100 (opens in new tab)(twitter.com)12junrushao19942y ago3Save
3Running RedPajama and other open LLMs on phones, browsers and AMD/NV/Intel GPUs (opens in new tab)(mlc.ai)11junrushao19943y ago0Save
4MLC: Bringing Hardware Accelerated Language Models to Consumer Devices (opens in new tab)(mlc.ai)8junrushao19943y ago0Save
5MLC-LLM: GPT/Llama on consumer-class GPUs and phones (opens in new tab)(github.com)GitHub303junrushao19943y ago106Save