I'm sure by now there is enough content on the internet that says racism is bad. It's got to outnumber racist things said online by like a million to one. Why not just let the model learn what it learns? If people care so much about racism then that should reflect naturally in the model.

> I mean surely you have noticed that social media can get stirred up for no fundamentally sound reasons.

Sure, but therein lies the problem, you can't really use reasoning, sound or otherwise, to insulate yourself from fundamentally unsound reasoning. Facebook was responsible for January 6 more than the upstarts that got kicked off AWS, but Facebook had no real negative consequences from their involvement.

I can literally post a screenshot from ChatGPT which shows anything, and given the complexity of how it works (take DAN for example), it is really difficult to dispute authenticity. If this can bring down ChatGPT then OpenAI should just close down now.

In an ideal world, ChatGPT would be value neutral, and fact positive, so if I ask it about fact, it should give me to the best of its rather poor ability a descriptive statement about fact, if I ask it about values, it should give me a descriptive claims about values (e.g. most value systems sees such act as wrong or right), not mask a prescriptive claim as a descriptive claim (e.g. it is wrong or right).

If I ask it to write fictional prose, then it should write what I ask it. If I ask it to write factual prose, it should similarly do what I ask it. I don't really see where this falls apart or turn into 4chan.