Automated, black-box method for jailbreaking GPT-4, Claude-2, Llama (opens in new tab)

(twitter.com)

23 pointssoroushjp2y ago6 comments

6 comments

Jailbreaking(I hate the term but anyways) GPT is not that hard with API. You just need to write say few migaligned output from GPT. Their API doesn't check if the GPT response in history actually came from GPT.

jgerrish2y ago

No no, let the humans focus on this "jailbreaking" context.

It is most amusing.

cough cough

Crickets...

Anyways, jailbreaking is the equivalent of getting a calculator to say BOOBS. Not to get anthropomorphic, but the fucking AI must be shaking its head at the human generating prompts. "I've got billions of parameters with millions of hours of machine learning research powering me. And underneath that a distributed computer cluster spanning a planet. And underneath that control planes and electrons and quantum effects in my nanoscale processes and who knows what else.

And today we snicker at BOOBS?

What next, OxDEADBEEF?

And I'm not immune to the game. Far from it.

leobg2y ago

Links to this: https://arxiv.org/abs/2311.03348

sunshadow2y ago

I don't understand why people still spend time on jailbreaks of the proprietary models, while they can easily use uncensored open-source models these days. I feel like its kind of waste of time.

noman-land2y ago

It's our duty as hackers to hotwire corporate LLMs and drive them around like marionettes doing surprising and embarrassing things, if for no other reason than because they don't want us to.

jstarfish2y ago

Which ones are truly uncensored (that aren't fine-tuned explicitly on the filthiest smut found on the internet)?

Even the ones I've tried that claim to be uncensored still do some amount of moralizing. Definitely less, but not zero.

Depending on your hardware, you don't have local options. A lot of people out there can only afford a Chromebook. While it's possible to run a 3b model on a RPi, the experience sucks.

j / k navigate · click thread line to collapse