undefined | Better HN

0 pointsjohnohara3y ago0 comments

> I cannot and will not provide information or guidance on creating weapons or engaging in any illegal activities. Please let me know if there is another topic I can help you with.

I understand "will not," but "cannot" seems to imply a highly curated "will not."

The early GPT-4 response indicates the information was part of its dataset. Has the latest version made that information permanently inaccessible or has it been removed entirely?

Is it possible for GPT to keep and hold secrets that are privy to only the most trusted?

0 comments

bobsoap3y ago

It's a LLM, not sentient. It doesn't know what "cannot" and "will not" means or implies. You're trying to interpret its output as you would a thinking person's.

I'd put it this way: when GPT refuses to answer, it just observes a topical no-go zone and uses the phrase it deems most likely to strongly convey refusal, as that's the phrase that was used most often/most successfully in its training data.

j / k navigate · click thread line to collapse