Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
0 comments
No comments yet.
Show HN: 60% higher tokens per second for 70B custom LLMs | Better HN
Show HN: 60% higher tokens per second for 70B custom LLMs
(opens in new tab)
(baseten.co)
1 points
mikejulietbravo
1y ago
0 comments
Share
We optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost
