Cutting LLM Costs by 83% with LangSmith (opens in new tab)

(medium.com)

15 pointsnick_rocks2y ago4 comments

4 comments

4 comments · 2 top-level

nick_rocksOP2y ago· 2 in thread

83% cost reduction seems impressive, but is this really an issue for anyone?

Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-l...

nick_rocksOP2y ago

Fair enough! But have you heard of 2 cases?

aazo112y ago

Is langsmith still useful if your app is not built with Langchain? Given how early these technologies wouldn't it be better to use a framework agnostic tool to not be tied in to a single framework?

j / k navigate · click thread line to collapse