undefined | Better HN

Skip to content

Top New Best Ask Show Jobs

0 pointshn87261y ago0 comments

Which models do you recommend for that amount of memory?

undefined | Better HN

0 comments

rpastuszak1y ago

I asked the same question a few days back and I'm keeping the responses here: https://bsky.app/profile/potato.horse/post/3lejngewfmc2n

mark_l_watson1y ago

For reasoning: qwq:latest (19G file)

For coding: qwen2.5-coder:14b (9G file)

Misc. experiments, runs fast: llama3.2:latest )2 G file)

j / k navigate · click thread line to collapse