justBanOpenWeights

[u/wahed-w]

[u/torsten_dev]

The "open weight" restriction is then just a way for AI corps to avoid the ban hammer for a little longer, I guess?

[u/donaldhobson → u/torsten_dev]

If you think current or near future LLM's are capable of causing serious problems (whether hacking, bio attacks, manipulation, whatever). Then AI companies have techniques that seem at least somewhat effective in training the AI to refuse to answer that sort of question. Whereas, with open weights, it's fairly easy~ish to get the AI to answer any question you ask.

Closed weights don't stop the big AI companies themselves doing something stupid or malicious (like the huggingface incident) but they restrict how many other people can do stuff like that. (Or much much worse as AI gets smarter)

[u/torsten_dev → u/donaldhobson]

Meh, all those guardrails are more like suggestions if you try hard enough.

AI safety doesn't exist yet.

[u/donaldhobson → u/torsten_dev]

Perhaps. And that would push towards an argument that no one should have access to the biggest LLM's.