Kimi K2.5 on 2 Mac Studios (<$20K) running at 24 TPS (opens in new tab)

(twitter.com)

6 pointsalexandercheema1mo ago4 comments

4 comments

Very impressive, would love to see the results from the verifier for this fully local setup: https://github.com/MoonshotAI/K2-Vendor-Verifier

alexandercheemaOP1mo ago

Is there one for Kimi K2.5?

Topfi1mo ago

Yes, it's in the repo.

thoughtpeddler1mo ago

Not to be glib, but how can people witness this and still shovel countless billions into GPU data center buildouts? Are there just two vastly different approaches supported here by the market?

j / k navigate · click thread line to collapse

4 comments

Topfi1mo ago

Very impressive, would love to see the results from the verifier for this fully local setup: https://github.com/MoonshotAI/K2-Vendor-Verifier

alexandercheemaOP1mo ago

Is there one for Kimi K2.5?

Topfi1mo ago

Yes, it's in the repo.

thoughtpeddler1mo ago

Not to be glib, but how can people witness this and still shovel countless billions into GPU data center buildouts? Are there just two vastly different approaches supported here by the market?

j / k navigate · click thread line to collapse