Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
0 comments
No comments yet.
Ask HN: Have you reduced costs by caching LLM responses? | Better HN
Ask HN: Have you reduced costs by caching LLM responses?
2 points
KennyFromIT
2y ago
0 comments
Share
Providing a chat bot to a large user base means you spend a lot of money on similar requests. I'm looking for best practices or lessons learned from implementing LLM-enabled apps at scale. Thanks in advance.