undefined | Better HN

0 pointsTostino1y ago0 comments

You could also just continue pre-training of an existing foundation model. Would still be cheaper by not starting from zero.

0 comments

a-s-k-af1y ago

The amount of accuracy while doing fine tuning or distillation is usually better than pre-training an existing model, not to mention the graph against the cost.

j / k navigate · click thread line to collapse

0 pointsTostino1y ago0 comments

You could also just continue pre-training of an existing foundation model. Would still be cheaper by not starting from zero.

0 comments

a-s-k-af1y ago

The amount of accuracy while doing fine tuning or distillation is usually better than pre-training an existing model, not to mention the graph against the cost.

j / k navigate · click thread line to collapse