AI guardrails stripped from Meta and Google models in minutes (opens in new tab)

(ft.com)

5 pointsuxhacker1mo ago4 comments

4 comments

4 comments · 1 top-level

uxhackerOP1mo ago· 3 in thread

Is not the answer to strip the dangerous information before training? Rather than trying to add guardrails post training.

ben_w1mo ago

Unclear if that is possible without making them incompetent.

Is it possible to learn chemistry without knowing at least two ways to make chlorine at home? Is it possible to learn biology without knowing that chlorine is dangerous to breathe?

Extend that to all the dangers in the world.

uxhackerOP1mo ago

How does China manage it with their censorship rules?

ben_w29d ago

AFAICT same as western AI: training them on political correctness (its just different politics*), and for website/app users testing the output and filtering forbidden output as it is generated (its just different forbidden output).

i.e., flawed.

* like accents, most people only notice those of other people, not their own

j / k navigate · click thread line to collapse