undefined | Better HN

0 pointscubefox3mo ago0 comments

Some yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.

0 comments

2 comments · 1 top-level

irthomasthomas3mo ago· 1 in thread

it enables models larger than was previously possible.

cubefoxOP3mo ago

No because the base model from which the distilled or quantized models are derived is larger.

j / k navigate · click thread line to collapse