Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
Show HN: 60% higher tokens per second for 70B custom LLMs
(opens in new tab)
(baseten.co)
1 points
mikejulietbravo
1y ago
0 comments
Save
Share
We optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost
0 comments
No comments yet.
