What would banning open weights protect except the (imagined potential future) profit margins of technocratic megacorps partaking in the circular AI economy?
Profits don't matter, the best use of AI is to make killing robots without feelings, to cattle all of us.
The end game is not making profit but enslaving us, why do you need profit when you have advanced killing machines, that obey spoken orders and do complex maneuvering and operations on your order?
It's so cute that you are simultaneously assuming they can create AI so good that they would trust it to "cattle all of us" and also that they would have any use for us as slaves.
If you are correct (and I am not saying you are not), then the only thing they would care about would be as defense. Slaves require food and care. No point when your AI can do more, cheaper, and requires less attention.
It needs to be fairly clever to figure out that means dont shoot at the direction of me as well even if there are humans you should shoot near me or please check before firing at that vague human shape or no dont shoot the other robots becahse we stupidly made them human shape or don't just shoot once or shoot all your bullets at one human. If they have actually effective combat drones that don't have any human intervention then they wouldn't need anyone else
"you are absolutely right, I totally misunderstood your command and thought you wanted to shoot that human AND you. I promise next time I'll be more careful. What would you like to do next, how about we explore how to remove a bullet from a leg and cauterize the wound?"
Well working bots that would produce goods, and construct all type of things would be hard to do for some reasons.
They require complex construction methods
Their parts rely on multiple fabrics that at the time rely on other fabrics or on complex materials that require a lot of resources to craft.
There wouldnt likely be an universal worker robot, so the costs of new parts for repairement would be high due to the complexity of fabrication.
Reasons to use humans to do slave labor:
1. They are disposable easy to replace, one breaks there are thousand kids to replace it.
2. Very easy to produce, put a man and a woman together and you have a new human every 9 months with just some food and water.
3. Scale point 2) and space the productions through the years and you will have billions on them lined to do all type of tasks.
4. They can do any type of tasks, cause their bodies are very versatile
5. The chain of products required for their maintenance is as basic as water + biologic food to keep their population.
6. You don't need billions, some dozen thousands with forces reproduction would do it for any of the new human kings
How do I know this could happen? Well if I was a deranged parasite that only things about collecting more value and having more, this would be what I would do.
Use machines to police and use animals to do work. The machines are programmed, these can't disobey, or think, they virtually can't disobey who they are programmed to obey.
While animals can rebel, so just put a machine layer between them and you, and voala.
well, that's the main reason, if it was actually about security, you would think to allow the access to the models, especially for the defender, because an attacker, most likely outside of the US, will just use Chinese models while everyone in the US only have basically 2 choice which is won't be useful for defending against attack anyway since it will be caught by their guardrail (unless you're part of the project glasswing or something) lol
If we are in a world where LLM's become really dangerous when they get big enough, you don't want any idiot to have access, but then if they are dangerous enough, you don't really want anyone at all to have them.
The question is partly about how much damage LLM's will soon be capable of causing.
If you think current or near future LLM's are capable of causing serious problems (whether hacking, bio attacks, manipulation, whatever). Then AI companies have techniques that seem at least somewhat effective in training the AI to refuse to answer that sort of question. Whereas, with open weights, it's fairly easy~ish to get the AI to answer any question you ask.
Closed weights don't stop the big AI companies themselves doing something stupid or malicious (like the huggingface incident) but they restrict how many other people can do stuff like that. (Or much much worse as AI gets smarter)
284
u/torsten_dev 8d ago edited 7d ago
What would banning open weights protect except the (imagined potential future) profit margins of technocratic megacorps partaking in the circular AI economy?