Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
tempoponet
22d ago
0 comments
Save
Share
It's fine for dense models where you need them in VRAM, less so for MoE where you're offloading layers to ram. But 32/32 is pretty good for both in the popular ~30b range right now.
0 comments
1 comments · 1 top-level
top
newest
oldest
xxs
21d ago
running 5090 on 32GB RAM is just weird, still
j
/
k
navigate · click thread line to collapse