undefined | Better HN

0 pointsdmw_ng2y ago0 comments

There's been instructions for manufacturing weapons useful for terrorism floating around since the BBS days, nothing new here

0 comments

cubefox2y ago

It's a big difference when you have an expert which you can ask questions.

Vetch2y ago

An AI that would be like an Illustrated Primer or the AIs from Fire Upon Deep is the dream from which we are currently far, doubly so for open source models. I wouldn't trust one with a sauerkraut recipe, let alone the instructions for a doomsday device. For the forseeable future, models cannot be relied upon without external resources to augment them. Yet even augmented with references, it's still proving to be a bigger challenge than expected to get reliable results.

xvector2y ago

Terrorists already have all the information they need to build some heinous shit with ~no external guidance aside from what's already on the internet.

cubefox2y ago

Engineered viruses could cause far more deaths than conventional weapons. Even more than nuclear weapons, and they are easier to manufacture.

1 more reply

hollowturtle2y ago

expert?! can’t do math why should suggest weapon instructions better? at the first hallucination you explode on the spot

ben_w2y ago

That's why we're not already dead.

If anyone releases all the weights of a model that does everything perfectly (or at least can use the right tools which I suspect is much easier), that model is far too valuable to make it disappear, and dangerous enough to do all the things people get worried about.

The only way to prevent that is to have a culture of "don't release unless we're sure it's safe" well before you reach that threshold.

I'm happy with the imperfections of gpt-3.5 and 4, both for this reason and for my own job security. But chatGPT hasn't even reached its first birthday yet, it's very early days for this.

1 more reply

cubefox2y ago

Even ChatGPT-3.5 could do more than a little math:

https://www.lesswrong.com/posts/qy5dF7bQcFjSKaW58/bad-at-ari...

j / k navigate · click thread line to collapse

0 comments

cubefox2y ago

It's a big difference when you have an expert which you can ask questions.

Vetch2y ago

xvector2y ago

Terrorists already have all the information they need to build some heinous shit with ~no external guidance aside from what's already on the internet.

cubefox2y ago

Engineered viruses could cause far more deaths than conventional weapons. Even more than nuclear weapons, and they are easier to manufacture.

1 more reply

hollowturtle2y ago

expert?! can’t do math why should suggest weapon instructions better? at the first hallucination you explode on the spot

ben_w2y ago

That's why we're not already dead.

The only way to prevent that is to have a culture of "don't release unless we're sure it's safe" well before you reach that threshold.

I'm happy with the imperfections of gpt-3.5 and 4, both for this reason and for my own job security. But chatGPT hasn't even reached its first birthday yet, it's very early days for this.

1 more reply

cubefox2y ago

Even ChatGPT-3.5 could do more than a little math:

https://www.lesswrong.com/posts/qy5dF7bQcFjSKaW58/bad-at-ari...

j / k navigate · click thread line to collapse