undefined | Better HN

0 pointsotabdeveloper41y ago0 comments

> Not to mention the current token cost.

Games is one place where running local LLM's is a no-brainer.

0 comments

1 comments · 1 top-level

With the advent of unoptimized UE5 releases becoming the norm and the mentality of shipping badly broken games by default and them only being in a good state years later if at all, I’m not sure running an LLM on device would be a good idea.

j / k navigate · click thread line to collapse