undefined | Better HN

0 pointswhimsicalism1y ago0 comments

? theyre not special tokens really

0 comments

i'm not actually sure whether they're special tokens in the sense of being in the vocabulary

<think> might be i think "wait" is tokenized like any other in the pretraining

j / k navigate · click thread line to collapse

i'm not actually sure whether they're special tokens in the sense of being in the vocabulary

<think> might be i think "wait" is tokenized like any other in the pretraining

j / k navigate · click thread line to collapse