undefined | Better HN

0 pointsPesthuf1y ago0 comments

Well right now, running this model is really expensive, but we should prepare a new cope for when equivalent models no longer are, ahead of time.

0 comments

cchance1y ago

Ya getting costs down will be the big one, i imagine quantization, distillation and lots and lots of improvements on the compute side both hardware and software wise.

j / k navigate · click thread line to collapse

0 comments

cchance1y ago

Ya getting costs down will be the big one, i imagine quantization, distillation and lots and lots of improvements on the compute side both hardware and software wise.

j / k navigate · click thread line to collapse