Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
nullc
1d ago
0 comments
Save
Share
Just running cpu only w/ Q6 on 9684X I get about 1tok/s ... also still get about 1tok/s/stream when running 16 in parallel.
0 comments
1 comments · 1 top-level
top
newest
oldest
nullc
OP
14h ago
6.5t/s if I add one RTX R6000 gpu (where is uses about 25GB).
j
/
k
navigate · click thread line to collapse
