undefined | Better HN

0 pointsintrasight1mo ago0 comments

Is that true? If the distillation is not lossy and the model runs much faster due to less resource consumption, then it may outperform.

0 comments

2 comments · 1 top-level

mwigdahl1mo ago· 1 in thread

One of those conditionals is a pretty huge assumption.

It's an assumption and it can be tested

j / k navigate · click thread line to collapse