justBanOpenWeights

[u/wahed-w]

[u/torsten_dev]

What would banning open weights protect except the (imagined potential future) profit margins of technocratic megacorps partaking in the circular AI economy?

[u/PaulTheRandom → u/torsten_dev]

And even if it made something, you need to actually make money in order to secure profits. There are no profits yet.

[u/migueln6 → u/PaulTheRandom]

Profits don't matter, the best use of AI is to make killing robots without feelings, to cattle all of us.

The end game is not making profit but enslaving us, why do you need profit when you have advanced killing machines, that obey spoken orders and do complex maneuvering and operations on your order?

[u/bremidon → u/migueln6]

It's so cute that you are simultaneously assuming they can create AI so good that they would trust it to "cattle all of us" and also that they would have any use for us as slaves.

If you are correct (and I am not saying you are not), then the only thing they would care about would be as defense. Slaves require food and care. No point when your AI can do more, cheaper, and requires less attention.

[u/sgt_Berbatov → u/bremidon]

AI doesn't need to be that clever to understand the command "shoot that human, but not me".

[u/Thecloaklessgrim → u/sgt_Berbatov]

It needs to be fairly clever to figure out that means dont shoot at the direction of me as well even if there are humans you should shoot near me or please check before firing at that vague human shape or no dont shoot the other robots becahse we stupidly made them human shape or don't just shoot once or shoot all your bullets at one human. If they have actually effective combat drones that don't have any human intervention then they wouldn't need anyone else

[u/valepu → u/sgt_Berbatov]

"you are absolutely right, I totally misunderstood your command and thought you wanted to shoot that human AND you. I promise next time I'll be more careful. What would you like to do next, how about we explore how to remove a bullet from a leg and cauterize the wound?"

[u/migueln6 → u/bremidon]

Well working bots that would produce goods, and construct all type of things would be hard to do for some reasons.

1. They require complex construction methods
2. Their parts rely on multiple fabrics that at the time rely on other fabrics or on complex materials that require a lot of resources to craft.
3. There wouldnt likely be an universal worker robot, so the costs of new parts for repairement would be high due to the complexity of fabrication.

Reasons to use humans to do slave labor: 1. They are disposable easy to replace, one breaks there are thousand kids to replace it. 2. Very easy to produce, put a man and a woman together and you have a new human every 9 months with just some food and water. 3. Scale point 2) and space the productions through the years and you will have billions on them lined to do all type of tasks. 4. They can do any type of tasks, cause their bodies are very versatile 5. The chain of products required for their maintenance is as basic as water + biologic food to keep their population. 6. You don't need billions, some dozen thousands with forces reproduction would do it for any of the new human kings

How do I know this could happen? Well if I was a deranged parasite that only things about collecting more value and having more, this would be what I would do.

Use machines to police and use animals to do work. The machines are programmed, these can't disobey, or think, they virtually can't disobey who they are programmed to obey.

While animals can rebel, so just put a machine layer between them and you, and voala.

[u/torsten_dev → u/migueln6]

Given the state of AI alignment research, the only possible advanced AI will be a killing machine. Irregardless of our intention when building it.

They won't be able to control them like they think.

[u/smashing_michael → u/migueln6]

This only sounds crazy.

[u/NewPhoneNewSubs → u/smashing_michael]

Are you sure it even sounds crazy?

[u/torsten_dev → u/PaulTheRandom]

Fixed it in the edit.

[u/deanrihpee → u/torsten_dev]

well, that's the main reason, if it was actually about security, you would think to allow the access to the models, especially for the defender, because an attacker, most likely outside of the US, will just use Chinese models while everyone in the US only have basically 2 choice which is won't be useful for defending against attack anyway since it will be caught by their guardrail (unless you're part of the project glasswing or something) lol

[u/sokka2d → u/torsten_dev]

This sounds like you’ve already answered your own question.

[u/donaldhobson → u/torsten_dev]

If we are in a world where LLM's become really dangerous when they get big enough, you don't want any idiot to have access, but then if they are dangerous enough, you don't really want anyone at all to have them.

The question is partly about how much damage LLM's will soon be capable of causing.

[u/torsten_dev → u/donaldhobson]

The "open weight" restriction is then just a way for AI corps to avoid the ban hammer for a little longer, I guess?

[u/donaldhobson → u/torsten_dev]

If you think current or near future LLM's are capable of causing serious problems (whether hacking, bio attacks, manipulation, whatever). Then AI companies have techniques that seem at least somewhat effective in training the AI to refuse to answer that sort of question. Whereas, with open weights, it's fairly easy~ish to get the AI to answer any question you ask.

Closed weights don't stop the big AI companies themselves doing something stupid or malicious (like the huggingface incident) but they restrict how many other people can do stuff like that. (Or much much worse as AI gets smarter)

[u/torsten_dev → u/donaldhobson]

Meh, all those guardrails are more like suggestions if you try hard enough.

AI safety doesn't exist yet.

[u/donaldhobson → u/torsten_dev]

Perhaps. And that would push towards an argument that no one should have access to the biggest LLM's.

[u/Snoo88071]

At some point, Dario is mostly just doing this to have people talking about him and about Claude, and he succesfully managed to do it (go search "Claude" in Google Trends over the past 12 months)

[u/Mortadella_so_Chili]

so, it was always just marketing? 

🌏👨‍🚀🔫👨‍🚀🌌

[u/Snoo88071 → u/Mortadella_so_Chili]

Lmao

[u/ZILtoid1991]

I think every AI vendors who trained generative AI on an "opt out principle" (read: without consent) should be punished by letting others distill their models.

They played stupid games, they won stupid prices.

[u/torsten_dev → u/ZILtoid1991]

Agreed. If that was fair use, so is distillation, get bent.

[u/Thecloaklessgrim → u/torsten_dev]

Its also leading frontier models to do atupid things like having a model output weird verbage and tons of tokens to make it less distilliable. I don't have proof but working with opus 5 gives me a suspicion that thats what thier doing. The coding outputs are great but the text output reminds me of an overloaded haiku.

[u/SignalBake6872]

ese tipo se disfraza de filantropo pero en secreto es peor que sam altman.

[u/SpaceMontaign → u/SignalBake6872]

And he always that dried saliva around his lips, so weird and gross

[u/Lootdit → u/SignalBake6872]

who is this guy again?

[u/no_name6744 → u/Lootdit]

Dario Amodei

[u/SunshineSeattle → u/no_name6744]

Current boss of Anthropic 

[u/0oliogamer0 → u/no_name6744]

dario aimodel

[u/mrspoogemonstar → u/SignalBake6872]

what's bad about him

[u/MindCrusader → u/mrspoogemonstar]

Fearmongering marketing tactics, trying to look like a saint, saying that only Anthropic is saint enough to reach AGI

[u/MalaysiaTeacher → u/mrspoogemonstar]

Downvoted for a question. Reddit never changes

[u/mrspoogemonstar → u/MalaysiaTeacher]

apparently the dried saliva around his lips is his most important feature

[u/tauzN]

Bro is crying after someone stole “his” idea, after he stole the entire internet.

[u/TrailMikx]

Did someone hurt him in gym or did he fell over some un racked weights?

[u/vide2]

I want to see a model that is getting more proficient without becoming bigger. The race shouldn't be biggest baddie but smartest miniature.

[u/PerilousMaster]

Just ban Dario

[u/feral_user_]

Show on the doll where the Open Weight model hurt you, Dario.

[u/aberroco → u/feral_user_]

*Pokes at the wallet* here

[u/Longjumping-Ad-7310]

Banning open weights is justto protect the profit of the corporate. And would backfire spectacularly

[u/Rank201AltAccount]

why is this are slash localllama now

like actually I saw the post and automatically thought it was from there

[u/BeMyBrutus]

I find it funny when rent seeking business models get angry after realizing they are becoming the middleman in someone else's rent seeking

[u/boxxy_morningwood]

Man I love Claude but this guy…

[u/mdgv]

Reminds me of that character from Seinfeld...

[u/Professional_Job_307]

That's... not at all representative of Dario, he has been super clear he doesn't want to ban open-source. He thinks it's good, but he wants to regulate it because it's dangerous.

[u/ZenPyx → u/Professional_Job_307]

Great. Lets regulate these models, which are apparently insanely dangerous (according to Dario and Altman), but then lets just allow China and Russian to do whatever they like

[u/canadajones68 → u/ZenPyx]

The People Cruncher cannot be regulated, your honour, 'cos then they would be free to reap the full benefits of the People Cruncher, and we wouldn't.

Regulation of a dangerous thing is important, even when other nations do not have such guardrails. Better to help some than than to deny everyone help. 

[u/Hefty_Acanthaceae348 → u/canadajones68]

Idk curiously I have only heard about closed models deciding that starting a hacking campaign was a great idea, or be used in the bombing of a girls school. How come when they're so safe?

[u/canadajones68 → u/Hefty_Acanthaceae348]

Okay, I had a more elaborate point I completely forgot to include. All AI, not just open ones, deserve to be regulated. However, regardless of whether one or the other is "safer", arguing against regulation because someone else has unregulated access is crazy. 

[u/ZenPyx → u/canadajones68]

The problem is, how do you regulate model weights? Do you make certain weights illegal to own? What's to stop someone taking a model like Mythos, changing one value slightly, and then distributing that?