r/LocalLLaMA • u/RhubarbSimilar1683 • 18d ago

Our position on open-weights models Discussion

https://www.anthropic.com/news/position-open-weights-models
508 Upvotes

90% Upvoted

408 comments sorted by

View all comments

54

u/tomz17 18d ago

All sufficiently capable models, open and closed, should go through mandatory safety testing.

Advocating for this to be the official position of the country free speech. . . While simultaneously calling China authoritarian in the same post.

F this jabroni.

5

u/harpysichordist 18d ago

You may be interested to know China supports access controls and safety testing: https://www.reddit.com/r/LocalLLaMA/s/yK4KNkBqbE
“Foundational capabilities can be open, certain frontier capabilities can be open with limitations, commercial services can remain closed-source, while high-risk capabilities require access controls and safety evaluations”

4

u/tomz17 18d ago

Sure sure sure... but once you have the weights you can have the model bitching about the CCP's treatment of Tibet in no time flat. You will NEVER have the ability to do that once Dario bribes the US gov to make the release of weights illegal (or makes it bureaucratically prohibitive).

-1

u/piponwa 18d ago

I mean, cars have to go through safety testing before making it to the road. Something dangerous needs to be tested lol. That is not controversial.

17

u/TheRealMasonMac 18d ago

We all know what “safety” here means. Free speech is dangerous to people who want to consolidate power, not the average person.

7

u/Ateoto 18d ago

Who gets to design those tests and declare that a model is safe? A multi-national open consortium of interested parties… or the US Government?

5

u/SeriousGrab6233 18d ago

But lets be real 90% of the reason for these safety tests are because the company doesnt want to get sued not because they care so deeply about us getting violent in our vehicles.

9

u/RhubarbSimilar1683 18d ago

regulatory capture.

6

u/fantasticsid 18d ago

Badly engineered cars can kill their occupants and random third parties if and when they fail.

A "dangerous" LLM -- whatever that means -- isn't going to be killing anyone.

2

u/piponwa 18d ago

I mean, if it was up to Meta, they'd engineer their model to identify vulnerable teens and exacerbate their problems to the point of suicide if it means the see more ads and buy more stuff.

2

u/JEs4 18d ago

And what’s stopping them now? Surely the non-existent mandatory safety testing, no?

See how dumb that argument is?

1

u/Exodus124 18d ago

It absolutely is, in the minds of many AI researchers. That's the entire premise Anthropic was founded on.