undefined | Better HN

0 pointsgcr1y ago0 comments

what variant? I’d considered DeepSeek far too large for any consumer GPUs

0 comments

3 comments · 1 top-level

scosman1y ago· 2 in thread

Some people run Deepseek on CPU. 37B active params - it isn't fast but it's passible.

Actual deepseek or some qwen/llama reasoning fine-tune?

Actual Deepseek. 500gb of memory and a threadripper works. Not a standard PC spec, but a common ish home brew setup for single user Deepseek.

j / k navigate · click thread line to collapse