Asking for the special tokens crashes ChatGPT (opens in new tab)

(twitter.com)

2 pointsbotverse2y ago4 comments

4 comments

This is most likely because ChatGPT returning the actual token corresponding to `<|endoftext|>` instead of returning the text representation of it

sp3322y ago

So it’s not crashing.

botverseOP2y ago

Try it for yourself, it enters in a loop, so it probably detects the abrupt termination and tries to start again, not sure how to call that behaviour, but crashing is not too incorrect in that case

sp3322y ago

Oh ok, I couldn't tell that from the screenshot.

j / k navigate · click thread line to collapse

4 comments

botverseOP2y ago

This is most likely because ChatGPT returning the actual token corresponding to `<|endoftext|>` instead of returning the text representation of it

sp3322y ago

So it’s not crashing.

botverseOP2y ago

Try it for yourself, it enters in a loop, so it probably detects the abrupt termination and tries to start again, not sure how to call that behaviour, but crashing is not too incorrect in that case

sp3322y ago

Oh ok, I couldn't tell that from the screenshot.

j / k navigate · click thread line to collapse