Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
Q8 KV cache lets a 30B model fit 100K context on a 24 GB RTX 5090
(opens in new tab)
(buraak.com)
3 points
bozdemir
1mo ago
0 comments
Save
Share
0 comments
No comments yet.
