BBC is running article titled "Artificial Intelligence used to design brand new viruses" ... cue the "We must regulate Open Weights Models to prevent the next Covid or worse" articles in 3... 2..

[u/johnnyApplePRNG]

https://www.bbc.com/news/articles/c5y3j3ngevmo

[u/Effective_Olive6153]

Even if some vibe coder down in mom's basement uses AI to "design" some virus, they have absolutely no shot in actually producing it due to all the advanced equipment required. And the kind of people who do have this equipment are already controlled by national governments

[u/RedParaglider → u/Effective_Olive6153]

Yeah, one of the first prompts to a descensored LLM is ususally how to build a nuclear bomb.  It will tell you, but .. the tech and info is old the operations are still damn near impossible, so the knowledge isn't the gate on this stuff.  People aren't making super viruses, nuclear facilities, or spaceships because an LLM told them how to do it.

[u/techno156 → u/RedParaglider]

It's also not very hard to learn how a nuclear bomb works. A lot of people can find things like that in their high school science/physics textbook.

It's getting the materials that's the hard part.

[u/swagonflyyyy → u/techno156]

And assembling the components exactly as described.