Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
undefined | Better HN
0 points
dymk
9d ago
0 comments
Share
It’s crazy that people don’t understand cached tokens despite them being priced separately on the cost pages of every single provider.
0 comments
default
newest
oldest
jauntywundrkind
9d ago
Its crazy that people think caching is such a silver bullet, despite the cost of long context windows still being ridiculously high even with caching.
https://blog.exe.dev/expensively-quadratic
https://news.ycombinator.com/item?id=47000034
esseph
9d ago
> It’s crazy that people don’t understand cached tokens despite them being priced separately on the cost pages of every single provider.
Depends on your subscription type. Some are just a flat monthly fee.
dymk
OP
9d ago
Those aren't the people worrying about token counts, then.
j
/
k
navigate · click thread line to collapse