undefined | Better HN

Skip to content

Top Best Ask Show New Jobs

0 pointsgrepfru_it1y ago0 comments

I am curious the need for 70 t/sec?

0 comments

5 comments · 2 top-level

Aeolun1y ago· 2 in thread

Waiting minutes for your call to succeed is too frustrating?

Depends entirely on the use case. Not every LLM workflow is a chatbot

no, but if you're not latency sensitive you should probably be using DeepSeek v3 (cheaper than flash, significantly smarter)

cootsnuck1y ago· 1 in thread

High concurrency voice AI systems.

grepfru_itOP1y ago

Why are you self hosting that?

j / k navigate · click thread line to collapse