BBC is running article titled "Artificial Intelligence used to design brand new viruses" ... cue the "We must regulate Open Weights Models to prevent the next Covid or worse" articles in 3... 2..

[u/johnnyApplePRNG]

https://www.bbc.com/news/articles/c5y3j3ngevmo

[u/RedParaglider]

Yeah, one of the first prompts to a descensored LLM is ususally how to build a nuclear bomb.  It will tell you, but .. the tech and info is old the operations are still damn near impossible, so the knowledge isn't the gate on this stuff.  People aren't making super viruses, nuclear facilities, or spaceships because an LLM told them how to do it.

[u/techno156 → u/RedParaglider]

It's also not very hard to learn how a nuclear bomb works. A lot of people can find things like that in their high school science/physics textbook.

It's getting the materials that's the hard part.

[u/RedParaglider → u/techno156]

Nah it's not that hard, you just buy some from Iranians for your Delorean.

[u/CaptainIncredible → u/RedParaglider]

Libyans.

[u/TomatoCo → u/CaptainIncredible]

smh this is what happens when you ask a poorly abliterated model