undefined | Better HN

0 pointsvidarh1y ago0 comments

See it as a temporary workaround, and assume each instruction will also lead to additional training data to try to achieve the same in the next model directly.

0 comments

2 comments · 1 top-level

kikimora1y ago· 1 in thread

It comes down to solving this - given instruction X find out how to change the training data such that X is obeyed and none other side effects appears. Given amount if the training data and complexities of involved in training I don’t think there is a clear way to do it.

vidarhOP1y ago

I'm slightly less sceptical that they can do it, but we presumably agree that changing the prompt is far faster, and so you change the prompt first, and the prompt effectively will serve in part as documentation of issues to chip away at while working on the next iterations of the underlying models.

j / k navigate · click thread line to collapse