undefined | Better HN

0 pointsabtinf3d ago0 comments

The lack of a token rate metric for the kimi example is disappointing.

0 comments

The latter link says they get ~1.7 tok/s which is quite impressive for a near-SOTA local model running on ordinary hardware.

j / k navigate · click thread line to collapse

0 pointsabtinf3d ago0 comments

The lack of a token rate metric for the kimi example is disappointing.

The latter link says they get ~1.7 tok/s which is quite impressive for a near-SOTA local model running on ordinary hardware.

j / k navigate · click thread line to collapse