Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
768GB Intel Optane DIMMs to run 1T-parameter LLM with single GPU at 4tps
(opens in new tab)
(tomshardware.com)
30 points
walterbell
23d ago
2 comments
Save
Share
2 comments
2 comments · 2 top-level
top
newest
oldest
lostmsu
22d ago
The bottleneck in this setup is PCIe bus. You don't need optane to saturate it. 4 regular SSDs might do just fine.
musicale
22d ago
Ah Optane, what might have been...
Even over PCIe, I imagine the advantage vs. NVMe is lower latency and more operations per second.
j
/
k
navigate · click thread line to collapse