undefined | Better HN

0 pointssinuhe691y ago0 comments

The demo they showed was full of repeated sentences. The 3B model looks quite dense, TBH. Did they just want to show the speed?

0 comments

1 comments · 1 top-level

3B models, especially in quantized state, almost always behave like this.

j / k navigate · click thread line to collapse