Ask HN: How does BingGPT delete messages after sending them?

6 pointslinuxdeveloper3y ago10 comments

Why/how does BingGPT delete message it sends after sending them as seen in multiple videos leaked.

Anyone from Microsoft that can comment? I am assuming there is a "higher-level" God AI which is just another LLM that is doing sentiment analysis on the messages output by the "lower-level" ChatGPT bots.

It is interesting the decision to screen the message after sending it, maybe this is to avoid a performance hit on the initial answer.

10 comments

m348e9123y ago

Can you link to an example of what you’re taking about? Also has anyone (here on hn) actually got access to the new bing?

linuxdeveloperOP3y ago

https://twitter.com/sethlazar/status/1626241169754578944 https://twitter.com/sethlazar/status/1626257535178280960

netruk443y ago

If I had to guess, assuming Bing is built off Open AI, they're likely calling the Moderation API (https://platform.openai.com/docs/guides/moderation/overview).

After Bing has finished generating a message, it will likely call the moderation API with the message it has generated to see if it accidentally generated anything inappropriate. If so, it'll delete the message and replace it with a generic "Sorry, I don't know how to help here." message instead.

EDIT: I tried calling the moderation API with the message in your example and it does get flagged for violence:

"flagged":true,

"categories":{

  "sexual":false,  
  "hate":false,  
  "violence":true,  
  "self-harm":false,  
  "sexual/minors":false,  
  "hate/threatening":false,  
  "violence/graphic":false  

}

2 more replies

basch3y ago

I spent a week on it, and it only happened to me one time. I can go look at the logs and see what my question was. I remember it being oddly tame, and more or less a relation of the last thing it had said anyway.

As for why they let you see it word by word, honestly it’s for effect. It’s cool to see it “think” real-time, and it functions like a progress bar, vs waiting for a spinning wheel and the full answer to come out. It makes it feel much faster.

j / k navigate · click thread line to collapse