1Scaling LLama2-70B with Multiple Nvidia/AMD GPU (opens in new tab)(blog.mlc.ai)13junrushao19942y ago6
2MLC LLM: 70B Llama-2-4bit on MacBook at 50%-80% speed of A100 (opens in new tab)(twitter.com)12junrushao19942y ago3
3Running RedPajama and other open LLMs on phones, browsers and AMD/NV/Intel GPUs (opens in new tab)(mlc.ai)11junrushao19942y ago0
4MLC: Bringing Hardware Accelerated Language Models to Consumer Devices (opens in new tab)(mlc.ai)8junrushao19942y ago0