undefined | Better HN

0 pointscatlifeonmars2mo ago0 comments

Why does a language model have to be monolithic? I think retraining a model is expensive (relatively speaking). Is there some way to bolt on specialization?

0 comments

1 comments · 1 top-level

ambewas2mo ago

That's exactly the issue. Retraining is too expensive & needs too much iteration to work efficiently I think.

j / k navigate · click thread line to collapse