3000 tokens/sec LLM playground (opens in new tab)

(playground.kog.ai)

6 pointsrashkov29d ago3 comments

3 comments

3 comments · 2 top-level

phillipseamore29d ago· 1 in thread

What am I missing? It can't even list countries in NATO correctly, chatjimmy.ai can do that and output 17000 tokens/sec on cheaper silicon.

rashkovOP29d ago

I don't think you're missing anything, the speed is the impressive thing but the model is limited. Perhaps Chatjimmy is more impressive in this respect. Most people haven't tried either

rashkovOP29d ago

Actually getting to use this is different than just reading about it. Feels like a preview of the future.

Related discussion of their writeup: https://news.ycombinator.com/item?id=48321076

j / k navigate · click thread line to collapse