Skip to content

Top New Best Ask Show Jobs

MLC LLM: Universal LLM Deployment with GPU Acceleration | Better HN

MLC LLM: Universal LLM Deployment with GPU Acceleration (opens in new tab)

(github.com)

3 pointscrowwork2y ago1 comments

1 comments

crowworkOP2y ago

Supported platforms include:

- Metal GPUs on iPhone and Intel/ARM MacBooks

- AMD and NVIDIA GPUs via Vulkan on Windows and Linux

- NVIDIA GPUs via CUDA on Windows and Linux

- WebGPU on browsers (through companion project WebLLM).

j / k navigate · click thread line to collapse