Seems easily countered by using the same toxicity prediction software when evaluating synthesis requests (but I'm not sure whether this actually matters, or whether skilled chemists can easily synthesize anything themselves anyway).
It's important to remember. Chemical warfare can be used for mass destruction, but this approach could be used for other nefarious things at smaller more discrete scales en masse. ie 1000 attacks with different agents in each one... Forensic nightmare.
I like your suggestion to counter these things, but, these are predictive tools. They can and often are or will be wrong. False positives would be a real problem. Again though the people interested in doing this won't be dialing up a chemical supplier to do it for them.
I would take whatever it has to say about untested chemical weapons with a very large pinch of salt.
Fortunately the training dataset for that is extremely small, and protein folding/generation is a different duck, but it still doesn't seem that far away.
Nice! So the only thing anybody training their own protein-folding AI is to not put that restriction, and they could get code for all the prion diceases they want!
Very comforting!
Like if it can be tricked into providing the equivalent of an interactive anarchist cookbook under the guise of being a science project assistant?
Or more specifically if it can recommend the necessary locations to get the items?
Curious if it could simplify the output to a shopping list and a recipe, like a cake?
Or alter the recipe based upon the… desired flavors and textures?
Maybe just wondering if the introduction of plugins might not let it just make your drive-up order for all the supplies for that ballistic nail spreader.
——
The big difference here is that previously information was something you had to consume. Now it takes you by the hand.
I have a lot of thoughts on this.
Then the internet came along and allowed you to obtain books such as the anarchist cookbook in the blink of an eye without knowing anyone.
We're just more comfortable with the internet.
Yes AI's ability to automate this is still dangerous, but lets not forget the internet was that dramatic step when it came about.
“ AI is dreaming up drugs that no one has ever seen. Now we’ve got to see if they work.”
https://www.technologyreview.com/2023/02/15/1067904/ai-autom...
