Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
angry_octet
1mo ago
0 comments
Save
Share
It seems that tool calling shouldn't be 500ms of latency?
0 comments
1 comments · 1 top-level
top
newest
oldest
hobofan
1mo ago
If you have tool calling complex enough that it necessitates a higher reasoning level, and you would otherwise have reasoning set to "none", this can easily come out to 500ms.
j
/
k
navigate · click thread line to collapse