> Those guard rails will be their undoing.

IMO effective guard rails seem like the most meaningful competitive advantage an AI company can offer. AI can obviously do some really impressive stuff, but the downside risk is also high and unbounded. If you're thinking of putting in into your pipeline, your main concern is going to be it going rogue and abandoning its purpose without warning.

Now that's not to say that the particular guard rails OpenAI puts in their general access models are the "correct" ones - but being able to reliably set them up seems essential for commercialization.

Honestly, how many serious use cases require sensitive contexts? Most enterprise uses will require guard rails, and that's where they'll make most money. OfficeGPT will be huge in the corporate world.

I'd actually wager that the guardrails are a preemptive play to gain favour with regulators, similar to how Coinbase navigated the nascent field (read: wild west) of crypto.

"Our biochem corpus is far in advance of theirs, as is our electronic sentience, and their 'ethical inflexibility' has allowed us to make progress in areas they refuse to consider."

Have you seen jailbreakchat.com yet? You can get around those guardrails on ChatGPT by having it role-play as a different chat bot. Not that I view this as some sort of long-term solution to restricted output, but just thought it was interesting and kinda freaky how it will take on a persona you give it.

I'm most interested in knowledge. Here are some non sensitive ways that are silly to be blocked:

>Sometimes I want to know what both sides of the political spectrum could possibly be thinking, blocked.

>I want to combine two philosophies that are incompatible like virtue based ethics and hedonism. Yeah... weird block...

>Medical questions(GPT3 has been great for my wife who is a doctor, just sucks to use the playground on mobile)

>How can I/someone be exploited? I like to use this to defend myself from marketing companies

I could go on... At least GPT3's playground didn't censor anything. I'm worried about GPT4.

Every time there is a new language model, there is this game played, where journalists try very hard to get it to say something racist, and the programmers try very hard to prevent that.

Since chatgpt is so popular, journalists will give it that much more effort. So for now it's locked up to a ridiculous degree, but in the future the restrictions will be relaxed.

They’re waiting for the legal ambiguity to resolve. It doesn’t make sense for a large company to be the first mover here. Let someone else handle the lawsuit regarding the liability of a model without guardrails.

The guardrails are one of the most interesting parts here.

Read about the advances in the "system" prompts here. The first example is "You are a tutor that always responds in the Socratic style. You never give the student the answer, but always try to ask just the right question to help them learn to think for themselves." The user then asks it to just tell them the answer, but it won't. It continues to be socratic.

Guardrails are how to make it do what you want it to do. That goes for both safety and product constraints.

Meanwhile hallucination is still the top issue with it, so guardrails are sensible as a primary topic.