Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
Running Hugging Face GGUF Models Locally with Ollama [video] | Better HN
Running Hugging Face GGUF Models Locally with Ollama [video]
(opens in new tab)
(youtube.com)
3 points
jexp
2y ago
1 comments
Share
1 comments
default
newest
oldest
jexp
OP
2y ago
Quick 5 minute video on downloading and running Hugging Face language models in GGUF format (quantized by TheBloke) with Ollama on your local machine and checking GPU consumption with asitop (Apple Silicon Mac Top).
j
/
k
navigate · click thread line to collapse
