Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
Storage based KVCache for denser token factory
(opens in new tab)
(blogs.oracle.com)
1 points
baruch
1mo ago
1 comments
Save
Share
1 comments
1 comments · 1 top-level
top
newest
oldest
baruch
OP
1mo ago
It is possible to get more tokens out of the same hardware by leveraging fast storage for KVCache, it is especially useful for agentic workloads.
j
/
k
navigate · click thread line to collapse
