undefined | Better HN

0 pointsDer_Einzige1y ago0 comments

Vllm serve… huggingface gives run instructions for every model with vllm on their website.

0 comments

1 comments · 1 top-level

How do I serve multiple models? I can pick from dozens of models that I have downloaded through Open WebUI.

j / k navigate · click thread line to collapse