undefined | Better HN

0 pointsjonaustin14d ago0 comments

note: 27b is going to be slow; use the 35b MoE if you want decent token/sec speed.

0 comments

Many of us tested 27B and 35B side by side, and the dense model is significantly smarter. It indeed is slower, but 35B makes a lot of mistakes 27B doesn't.

j / k navigate · click thread line to collapse

0 comments

dexterlagan13d ago

Many of us tested 27B and 35B side by side, and the dense model is significantly smarter. It indeed is slower, but 35B makes a lot of mistakes 27B doesn't.

j / k navigate · click thread line to collapse