undefined | Better HN

0 pointstrashcan21372mo ago0 comments

  and the EOS is "<turn|>". "<|channel>thought\n" is also used for the thinking trace!

Can someone explain this to me? Why is this faux-XML important here?

0 comments

2 comments · 2 top-level

That’s how the model is trained to signal the end to its generation and to indicate its thinking.

These are likely individual tokens. They are super common.

j / k navigate · click thread line to collapse