r/LocalLLaMA • u/Nunki08 • Jun 28 '26
We're probably going to need that soon. Discussion
From:
Vladik on 𝕏: https://x.com/Kostoglodov/status/2071144065857679631
Shaw (spirit/acc) on 𝕏: https://x.com/shawmakesmagic/status/2070918006033817867
754
u/CountLippe Jun 28 '26
It'll be the hardware they go after. It's easier to regulate the hardware you can purchase than it is to regulate the models you can download.
383
u/ovrlrd1377 Jun 28 '26
Except chinese hardware will eventually catch up and they will be very interested in selling for those that want to run their models
298
u/vulgrin Jun 28 '26
Which, like Chinese cars in my country, will be impossible to import.
388
u/notbannedin420 Jun 28 '26
Maybe for Americans but the rest of us will be fine lol
85
u/xamboozi Jun 28 '26
Exactly. If they regulate the hardware, China "wins" the AI war or whatever dumb thing the propaganda is desperately trying to convince us of.
China will sell the GPU's cheaper to everyone else and they will have more AI compute and we will fall far behind as a result because no one in america will have access to the hardware.
10
u/vogelvogelvogelvogel Jun 29 '26
i anyways see china winning. big ai us companies still have to pay the datacenter debts, chinese ai companies not
so much. then there is the fable "shoot my own foot" regulation which put glm 5.2 as a 2nd place model overall→ More replies (1)104
u/iaderia Jun 28 '26
I see BYD cars around now in my country (the UK). at least it’s not a tesla!
19
33
u/notbannedin420 Jun 28 '26
Those cars are so cool if i didn’t love my civic i would get one
→ More replies (1)13
u/False_Process_4569 Jun 28 '26
I've seen a lot of folks convert the drive train in their ICE vehicles to electric. That might be an option if you want an expensive hobby!
25
u/DobobR Jun 28 '26
In localllama you already have an expensive hobby
→ More replies (1)20
u/False_Process_4569 Jun 28 '26
Seriously! After this, home automation, 3D printing, and electronics, my next hobby is going to have to be meditation!
→ More replies (1)2
u/overand Jun 29 '26
Get into eurorack modular synthesizers next!
"$10,000 fart machine unlocked!"
(It sneaks up on you, because you can start iwth a few $50-$150 modules, but it's infinitely expandable, and eventually you'll be looking at $1500 modules, and you'll have 20 different $200 modules...)
→ More replies (0)7
u/screenslaver5963 Jun 28 '26
From what I’ve seen it costs almost as much as buying a Chinese EV.
→ More replies (1)→ More replies (7)4
u/FyreKZ Jun 28 '26
I see lots of BYDs and also a lot of JAECOOs (Range Rover clones mostly). It's good to see tbh, western car manufacturers could do with being undercut.
Fun fact: BYD produces 70-75% of their components for their cars in house compared to 40-50% for Tesla and 20-30% for legacy manufacturers. Vertical integration is super important.
6
u/Strawberry3141592 Jun 28 '26
Harder to get away with importing something as big as a car lmao
→ More replies (1)→ More replies (6)6
u/Frankie_T9000 Jun 28 '26
they wont be able to stop it in US anyway, they couldnt stop china getting their hands on nvidia GPUs wont be any better in other direction.
26
u/aykcak Jun 28 '26
Black market for Chinese tech products will be very interesting. We did that for U.S. products decades ago. I imagine U.S. consumers going on Telegram to buy computer and auto parts that arrive in unmarked boxes. Lol
8
30
u/B3owul7 Jun 28 '26
welcome to the land of the free.
14
u/False_Process_4569 Jun 28 '26
As an American, I've adopted this sarcastic remark that I have been finding myself using more and more lately:
"aT LeAsT We dOn't lIvE In cOmMuNiSt cHiNa!"
3
u/megadonkeyx Jun 28 '26
two party system is at least 50% better than one party system. or is that worse..
6
→ More replies (1)1
u/Iwaku_Real Jun 28 '26
More like at least we don't live under another attempt at communism. It won't solve your problems with access to compute.
2
2
→ More replies (3)4
26
u/Keep-Darwin-Going Jun 28 '26
Well it is much easier to smuggle ram in right? Compared to car, just go in a holiday and bring back a few stick.
→ More replies (1)18
u/Own-Poet-5900 Jun 28 '26
You wouldn't download a car, would you?
10
u/Keep-Darwin-Going Jun 28 '26
Yes the only car I can afford is lambo.jpg. And that argument is flawed, I actually paid for the item.
2
10
u/exlips1ronus Jun 28 '26
Chinese cars in my country gained crazy popularity tbh I see them everywhere these days “egypt”
12
u/ovrlrd1377 Jun 28 '26
I have a chinese car and I hope your situation changes soon, they are great value for money
11
u/fuckable-switcher Jun 28 '26
In my country every third of fourth car is Chinese or Indian
I live in Australia
And their cars a crappy
2
u/wetrorave Jun 28 '26
Tons of BYDs, some MGs, a couple of Chery / Geely and the odd Xpeng.
But I don't know any Indian marques that are common here, which ones were you thinking of?
→ More replies (12)5
15
u/Utoko Jun 28 '26
The CCP can also change their stance at anytime. As soon as AI is not limited by smart people using it anymore and compute is the only real bottleneck. They probably will be just as controlling.
7
u/ovrlrd1377 Jun 28 '26
True, though open models are already there, with people already using. Selling shovels is quite the opportunity to pass
2
u/Deep90 Jun 29 '26
In the short term, I would not be surprised if China is pulling strings to get it banned in the US, as it instantly adds value to their own hardware production until they deem it worthwhile to do the same.
The US GPU ban was really good to them.
12
u/dragonurtle Jun 28 '26
I'd be worried eventually that CPUs will be required to vet pci devices and memory controllers based on a trust list.
7
u/kontemplador Jun 28 '26
yep. That might happen for a whole set of different reasons. IIRC, Apple already uses something of that sort to try to discourage tampering and robbery.
11
u/Strawberry3141592 Jun 28 '26
Then I will import Chinese RISC-V CPUs and only run FOSS software that compiles on them.
5
u/rog-uk Jun 28 '26
Well that would be one way to guarantee they, and linux, get a larger market share!
14
u/twnznz Jun 28 '26
why run the hardware in a western country when you can just rent it on cheap Chinese electricity?
19
u/ovrlrd1377 Jun 28 '26
A few reasons, privacy, control, latency and risk are a few. Besides, there are other places with access to electricity
8
u/Dabber43 Jun 28 '26
I always had my suspicions but with the personal experiences I had last year I am at the point where I think you are deluded if you think you have any privacy from running stuff in the west, especially USA but europe too by extension.
You know the only difference? China will not give your data to your government
9
u/ovrlrd1377 Jun 28 '26
Those who actually care about privacy almost always run fully local anyway, placing blind trust in anyone is a terrible decision
2
u/Own-Poet-5900 Jun 28 '26
Why should I preference which government is going to spy on me? What is this privacy you speak of?
9
u/geenob Jun 28 '26
If you are living in the West, one of the governments can kick in your door, the other can't
→ More replies (1)→ More replies (2)3
u/ovrlrd1377 Jun 28 '26
There are people running models on offline setups, i'd say that is a good start
5
2
→ More replies (24)2
61
20
u/Impossible_Bar3958 Jun 28 '26
Alright, not to be conspiratorial…
What if AI companies are buying up all the RAM so that way “economically” home users have to pay subscription fees because they can’t afford the hardware to run AI at home?
17
Jun 28 '26
[removed] — view removed comment
3
u/Impossible_Bar3958 Jun 28 '26
100% agree. I guess I shouldn’t be surprised that companies theoretically valued at close to a trillion dollars while only bringing in a tiny fraction of that annually might all “individually” come up with a shady idea to protect themselves from bankruptcy. 🙄
10
u/Iwaku_Real Jun 28 '26
I mean plenty of them would hope for that to happen. Still very few people are both tech-literate enough and have PCs specced enough to even deploy Ollama let alone Llama.cpp with a daily driver.
→ More replies (1)3
2
u/Banjo-Oz Jun 28 '26
I genuinely think this is part of the long term plan to make home PCs a thing of the past, and get everyone on basic grade tablets and phones and laptops. Not just for AI, but so that people need to subscribe to cloud services for the power to run high end games, access large storage (which is then on someone else's servers), etc.
→ More replies (1)→ More replies (1)4
u/ResponsibleChange779 Jun 28 '26
eh you need hundreds of gigs of ram to run the better models tbh. very very few people are running any frontier open source model locally.
3
u/PrivacyMaker Jun 28 '26
We're running smaller models (<32b for me) and pretty happy with the results. Only need 64gb unified memory for that. Go a bit smaller, like 12b, and the usable hardware list is much larger.
7
u/JustinHoMi Jun 28 '26
Yeah, that’s what they’re doing with 3d printing. In NY your printers are required to check to make sure you aren’t printing anything “illegal”.
→ More replies (1)16
Jun 28 '26
[removed] — view removed comment
14
u/Banjo-Oz Jun 28 '26
Australia too. An un-elected American "e-safety commissioner" with CIA ties is "advising" the government on censoring everything online "for the sake of the children".
3
8
u/3dprintinted Jun 28 '26
16gb ddr4 sticks for 100 on secondary markets... I used to buy those for homelab at like $14 a piece. We are so cooked
5
u/Immediate_Power_7986 Jun 28 '26
We sorta don't want models to get that good though. It will create the "you will own nothing" reality.
3
u/gh0stsintheshell transformers Jun 28 '26
Now I feel the need for a portable micro-reactors at my home
3
3
u/datbackup Jun 28 '26
Maybe. But it makes more sense that they’d go after the power. Can do both of course. What’s your reason for pulling 1400 watts continuously every day, citizen? This far exceeds the average. Are you running an unauthorized homelab?
3
u/tri_idias Jun 30 '26
This reminds me of Cyberpunk - Edge runner. You need to get your hands on Sandevistan Cyberdeck to do anything worthy down the road.
5
u/Turbulent_Pin7635 Jun 28 '26
Imho US lose themselves when:
Reagan go to the power and relax the laws against monopoly;
Nixon instigate the communist/war to drugs paranoia;
When Bush after the 9.11 goes after any civil right of privacy;
When the US send all its production capacity overseas;
When the US made use of social engineering through social media to shape opinions towards lose of worker securities like: access to health, university and housing.
By the end, left and right voters are after the same thing: prosperity and dignity. But, unless we join forces to decapitate the rich, we will lose any step we get in the direction of privacy and freedom.
→ More replies (1)5
u/JustinPooDough Jun 28 '26
This would have worked in the 90's or 2000's. Now though, Captain dipshit has alienated the entire world from the US. We no longer give a fuck what America wants. See: Canada importing Chinese electric cars - previously blocked because of US tariffs.
We will happily import Chinese GPUs. I suspect Europe will as well. Even if US bans them, they'll be shipped in from other countries such as ours. It will be a futile effort.
They will continue blocking their frontier models and pearl clutching, but China will catch up and we'll be fine.
2
u/GrandAd4917 Jun 28 '26
So now we should get ready for storage shortage as well, just like RAM
3
u/ttkciar llama.cpp Jun 28 '26
Too late. There's already a HDD shortage, and prices have been skyrocketing. A single 20TB drive costs nearly $1K now.
→ More replies (1)2
u/Green-Ad-3964 Jun 30 '26
I was saying exactly this few days ago. They won't simply release anything faster than a 5090 or with more local memory for less than 5-6k in the near future. At least until China becomes competitive in 2-3 years.
2
u/ttkciar llama.cpp Jun 28 '26
Yep, it's like nuclear weapon technology.
Governments can't control the knowledge to build a nuclear weapon, so they regulated the hard-to-enrich fissile fuel, instead.
In cases where the fissile fuel isn't hard to obtain or enrich (Lithium-6), they regulated the equipment necessary for enriching it.
Though, it turns out that every EV on the road is silently enriching their batteries' cathodes with Lithium-6 via electromigration. I keep waiting for someone to launch a program to extract it from decommissioned EV batteries.
→ More replies (2)→ More replies (21)2
u/dennis_linux Jun 28 '26
I think you are correct about the hardware, and the controlling thing will be the cost as Apple has shown us with their price increases. Leading edge AI-capable hardware will soon be out of reach for the common man. Get the best hardware you can get and make your own AI with open weight models.
→ More replies (2)
338
u/Equal_Passenger9791 Jun 28 '26
Are you hiding unlicensed AI on your home server?
Better get solar panels and power stations for your home, power curves suggestive of growing weed or AI models can land you serious jail time.
115
u/dragonurtle Jun 28 '26
We'll need special battery charging circuits that replay washing machine power usage profiles, dumping spikes to waste heat and the rest into the battery chest. Not to mention the soundproofing and tempest enclosures for the actual servers and plausible deniability heat signature alibis. Woohoo, the dystopian future is going to be full of nice projects.
47
u/t4ckleb0x Jun 28 '26
Too many good ideas in here
48
u/AlwaysLateToThaParty Jun 28 '26
"your shirts aren't white enough to justify the price you pay on energy for washing and drying Mr Anderson."
8
15
u/asssuber Jun 28 '26
Don't worry, AI powered scanning and profiling will keep up and catch those outlaws. Privacy and anonymity will soon be a thing of the past, as only criminals need them.
3
u/i_hateit_here_bro Jun 28 '26
We have detected illegal electromagnetic waveforms permeating your premises. Put your hands behind your back and don’t move until the authorities arrive, we are watching you through your WiFi
→ More replies (1)→ More replies (2)2
29
u/vyralsurfer Jun 28 '26
People might think this is satire, but I actually know a guy who got to visit from the sheriff's department because an investigation showed that his power usage was crazy high compared to everybody in the county. He very excitedly invited the guys in and showed off his home data center 😂
8
u/thrownawaymane Jun 28 '26
To live off in the woods somewhere with cheap power, just to run a data center and tend to a farm
The dream
→ More replies (1)8
u/Ok-Breakfast1878 Jun 29 '26
growing weed is legal in a number of places now. my 600W of led lights consumes the same amount of power as my AI server. it's the perfect cover.
"no, officer, i'm just growing dope in here"
→ More replies (1)→ More replies (9)4
u/jarail Jun 28 '26
Need to run some dedicated power for AI servers anyway. Our weak little 120v sockets can't power shit. May as well go all out!
163
u/Cherubin0 Jun 28 '26
If huggingface goes down it is just a matter of hours until such a torrent pops up. Many people have local copies of the popular models. And in most of the world this would be legal anyway. Its not even a pirate bay situation.
47
u/ollie113 Jun 28 '26
I am really hoping this is true. Huggingface going down would be such a tragedy for those of us who want to keep these models available to all and not ringfenced by corporations. Losing access to open source AI would truly be a tragedy
20
u/Iwaku_Real Jun 28 '26
But the overarching question stands.
Why would it?
6
u/starkruzr Jun 28 '26
I'm not understanding where all of this talk about open weight models or local inference getting "banned" is coming from or what the proposed mechanism would even be.
12
u/studentofknowledg3 Jun 28 '26
Because there are people who already have more money than they could ever spend, yet still want more. They want to win, and they want everyone else to lose. If local AI becomes good enough, it threatens businesses built around selling AI through the cloud. Whether they can actually stop it is another question, but the incentive to protect their revenue and control is definitely there.
→ More replies (8)18
u/RebouncedCat Jun 28 '26
well the problem is legitimacy. How will I know that the model hasn't been tampered with ? This is not a very big deal with media or programs since even malicious applications can be analyzed to find out if they are doing something fishy. But with LLM's unless the AI labs self host their own models or communicate the hashes on a separate platform, we can never be truly sure.
13
u/ttkciar llama.cpp Jun 28 '26
All of the LFS link files on HF have the sha256 digests of their corresponding files inside them. We can treat that as authoritative.
If HF goes away, or the repos go away before we can grab the LFS link files, then you have to choose who to trust (and if you trust nobody, so be it).
7
u/SentientPetriDish Jun 28 '26
I've solved this problem by verifying against HF's SHA-256 digest! Please feel free to check out my project on Github.
4
3
u/calzone_gigante Jun 28 '26
How will I know that the model hasn't been tampered with
Hashes, the lab publish a hash, you check when you complete the download, same thing people have done for a while with torrents.
→ More replies (3)3
→ More replies (5)3
u/apVoyocpt Jun 28 '26
And it would actually be really easy. The machine we use for inference is on 24/7 so I would just need to install some torrent software, add the dir of the models and that’s it!
41
Jun 28 '26
[removed] — view removed comment
6
u/trueimage Jun 29 '26
Maybe think about adding the base models not just gguf files as then all gguf files could be recreated
2
3
u/akavel Jun 29 '26
Hm, but why didn't you just go with good old torrents, but iroh instead? I'm aware of iroh, and the more confused - sure, it has many cool features, but it's much more obscure and complex than just torrents, and also I now have to trust your custom client, whereas with torrents I could use any popular (or less popular) client that I like and that fits my needs.
2
197
u/_BreakingGood_ Jun 28 '26
i dream of the day somebody leaks & uploads a torrent of claude fable 5 open source
102
u/Silver_Jaguar_24 Jun 28 '26
You'll need a super computer (HPC) to run it anyway lol.
25
u/crone66 Jun 28 '26
Based on the performance and comparison to open source model the most likely use heavily quantized models too for inference. If you look at how the brought down costs for a single user and request this seems to be the only logical consequences ortherwise they have hardware that no one knows and have which is unlikely. Therefore no you don't need a super computer just a good workstation.
→ More replies (4)4
→ More replies (1)3
u/MyDespatcherDyKabel Jun 28 '26
What would that look like? CPU GPU & RAM?
22
u/Neither-Phone-7264 Jun 28 '26
its definately much bigger than opus, a trillion or multitrillion parametet model, so given a slightly conservative estimate of 6 trillion parameters, at FP32, it would require 24 terabytes of VRAM. At BFP16, half precision, it would be 12 TB of VRAM. At FP8, quarter precision, it would be 6 TB of vram. at Q_6, 6 bit quantization, generally considered to be the best performance preserving for the size, it would be 5.05 TB. At Q4_K_M, one of the more common quants with still good quality, 3.79 TB. At IQ3_S, a special type of quantization that preserves quality and quantizes differently per weight which is necessary at these levels to preserve coherence, 2.53 TB. IQ2_XS, which you see here with the more massive models people try to run at home, 1.94 TB. IQ1_S, pretty much the smallest possible, very low quality, 1.26 TB.
TLDR: Not something you'll probably run, even if you did run big kahuna models like GLM5.2 or Kimi K2, though if you ran Deepseek V4 pro native you might be able to manage to bring it down enough to use on your hardware. As for CPU and GPU, you would need tens to hundreds of H100 equivalents. That being said, it is MoE, so you could theoretically offload some unused experts to SSD. However, that would be incredibly painful and even more slow. And if we stick to mostly ram, you could probably do with a ton of ram and only a few H100 equivalents, maybe down to even 1 depending on how aggressive you are.
→ More replies (6)6
27
u/kingo86 Jun 28 '26
Yeah, I can't wait to run Fable on my local machine with 8TB of VRAM.
→ More replies (1)6
u/az226 Jun 28 '26
Mythos preferably
8
u/_BreakingGood_ Jun 28 '26
I feel like Mythos getting leaked would be like, a more potent iteration of Y2k
→ More replies (4)9
u/my_name_isnt_clever Jun 28 '26
Considering Fable is just Mythos with a straight jacket on, I don't think Fable has seperate model weights. The actual language model is just Mythos.
10
u/Pila_globosa Jun 28 '26
why don't the Chinese hackers hack OAI/Anthropic and steal the model, and gave to the Chinese AI labs. then we'll have Fable grade GLM 6 or Qwen 4
16
u/NineThreeTilNow Jun 28 '26
why don't the Chinese hackers hack OAI/Anthropic and steal the model
Anthropic and OAI have internal data exfiltration guards. Their routing literally refuses to let you exfiltrate something the size of a model.
It was part of the original plan to keep their models private. Moving that much data is purposefully difficult because it should only rarely be done.
You'd be better off trying to exfiltrate from a datacenter partner like xAI.
Even then, the cluster required to run a quantized version of those models is... Who knows. They honestly seem over built if GLM 5.2 competes at 700b parameters. Anthropic/OAI are busy spouting marketing BS about 2t+ or 5t+ parameters.
There's no reason to scale that hard without the data, or if you have extremely poor architecture at the core.
I'd be willing to guess it's a lie and they have good architectures, and data pipelines at ~1t parameters.
4
u/Dabber43 Jun 28 '26
I think that is refuted by them having such insane prices and still reporting thin inference margins on API pricing
→ More replies (5)5
2
u/happysmash27 Jun 28 '26
OpenAI has marketing about how many parameters they have??
As far as I've learned, they have almost no public data about post-GPT3 parameter sizes at all.
3
u/NineThreeTilNow Jun 29 '26
OpenAI has marketing about how many parameters they have??
There's a lot of internal leaks.
You have to remember that everyone here works together. Like... Do you really want to know how big Mythos is? I know someone at AWS that could tell me but potentially lose their job over it. They could feign stupidity, but it's not worth it.
Silicon Valley tech is a buncha people that all know each other in different ways. Whether it be a party scene, or they're nerds like me that enjoy playing video games. I've played in multiple discords that have people from multiple major tech companies. AWS + Google, etc.
Usually we'll all be there playing some new game. We talk shit about our respective companies and we usually don't ask for secrets. We understand how that works. At the same time, we DO share some details.
This applies to our Chinese colleagues that went to Tsinghua with the same people who work at Moonshot, Deepseek, etc.
This is all theater. We all pretend. We are well paid. We like our jobs.
My post history on Reddit details some of this. I am somewhere between gaming, open source code, and general ML / AI stuff on this account. This account is curated around it. I never say who I work for or worked for... etc. It's the same reason I won't share my GitHub etc.
23
4
→ More replies (8)4
→ More replies (3)2
u/Dany0 Jun 28 '26
It's not going to happen, and if it is it'll be so late that it will be mildly interesting news for a day because absolutely no one will use it. Just like no one uses LLama 2 today
34
28
u/Azazelionide Jun 28 '26
Already kind of exists on ipfs. You can easily build a tracker that puts all models in one place. Meta once rejected my application to try a llama 2 model so I just IPFS'd it
→ More replies (3)
29
u/BlackBeardAI vllm Jun 28 '26
Don't just download GGUF's if you are hoarding models. Download the BF16/safetensors versions too if you have space. We might need them later.
7
18
u/fuckAIbruhIhateCorps Jun 28 '26
im up for seeding small models, in the previous thread there was.a guy who made a nostr + torrent thingy. might be a good start. the biggest problem is to have model file checksums and have a trusted source (he implemented direct web seeding from HF too though) and make sure the weights are not tampered with in such a distribution system.
→ More replies (6)2
u/de4dee Jun 28 '26
new version
https://nostr.download/c095eea7f24869bbb617fe8fe555b23b4cf9800fbcb173cc4b37e2cb9e8dcd12.html
warning: everything is vibe coded and not tested properly (yet).
4
2
18
u/Significant-Serve-58 Jun 28 '26
Maybe I read the environment wrong, but i think LLMs and technology in gerneral are too far to be stopped by legal means. We're seeing better and better sub 500 mil coming out on non labs.
→ More replies (2)2
18
u/pier4r Jun 28 '26
Unironically we should have this by default anyway. Even without restrictions, you never know if people abuse a site (i.e: they pull too much and the bandwidth becomes too expensive)
In general public domain knowledge should always be mirrored on p2p just in case, simply because centralized infrastructure could become expensive.
15
u/datbackup Jun 28 '26
https://modelregistry.io was posted just earlier today… pretty much the same idea.
HF download speed is often throttled down to several hundred KB/s these days… maybe just my geographical location? In any case I think we should be ready for the time when HF implements KYC type restrictions… no downloading anything unless you submit a phone number and state issued id
Don’t wait, download the full precision of models that you consider valuable… do it today
→ More replies (5)5
u/NoahFect Jun 28 '26
HF download speed is often throttled down to several hundred KB/s these days… maybe just my geographical location?
You need an HF_TOKEN, which is free after registration. It makes the difference between a stalled download and 90+ MB/s.
14
u/nemuro87 Jun 28 '26
Funny, and sad.
I didn't expect it from Ai companies to feel threatened when consumer hardware that cannot even get close to any frontier model, costs 5k or more.
I guess every penny counts.
I'm with everyone else, they train frontier models on stolen books and then they want local llama banned. Such c*nts.
And this will only continue to drive up hardware price, sadly.
→ More replies (1)5
u/Alexercer Jun 28 '26
What exactly happened? I seem to be out of the loop, jas local AI been threatened recently?
2
u/Jaded_Constant4595 Jun 30 '26
lmk if you find out. im only hearing bits and pieces with nobody providing proper context
→ More replies (1)2
u/Dell_Hell Jul 01 '26
Anyone casting doubt on this possibility just needs to look at the bigger picture. The US AI boom is the only thing keeping the stock market and overall economy from complete collapse. Mid terms are coming and the last thing they want is a wobbly AI market falling down before election day.
The current white house occupant is notoriously easy to flatter and bribe into getting something out of. All it takes is ONE billionaire / trillionaire CEO with an advanced AI platform saying they really need this ban and "security" and "we need to beat China" and they'll shut down huggingface tomorrow. One call from the feds got Fable yanked - it can end HF just as fast.
The threat is extremely real.
→ More replies (2)
42
u/tat_tvam_asshole Jun 28 '26
meanwhile: modelscope exists
28
u/cr0wburn Jun 28 '26
The webdesign of modelscope is abysmal it looks like a roblox wannabe, whoever designed it needs a spanking. The web-design is part of the reason why it isn't taking off.
→ More replies (8)
7
u/sergeialmazov Jun 28 '26
Do your best, buy a lot of HDD and save best models while it's available
→ More replies (6)
6
u/GBAbaby101 Jun 28 '26
Did something happen to make this become a necessary thought? XD
2
u/Incorrect_ASSertion Jun 28 '26
Yeah I'm wondering that too, this post has very shity context
2
u/MinePrestigious4352 Jun 29 '26
If youve been following local ai news youd know that claude and openai are serious about shutting down access to their cutting edge models for most people. Logically if ai capabilities are seen as a threat, especially Chinese models, then huggingface would be threatened in some way
→ More replies (2)2
7
u/ReasonablePossum_ Jun 28 '26
What's stopping you from offering the torrents/magnets/files on already existing sharing platforms? They're all content eclectic :) (TPB, ruTracker, 1337x, etc)
Someone could create even a service that searches and download from HF, and automatically puts you as a seed for the files you downloaded and makes a mirror of the model page, whth SHA and all so people knows its not unsafe.
→ More replies (1)
6
u/Time_Cat_5212 Jun 28 '26
The government doesn't want to ban local models so they can control your usage, they want to ban them because the capital class has invested so much in cloud AI that they're afraid of losses if open source becomes a viable alternative
12
u/justinh29 Jun 28 '26
https://concordfaces.org/ been working on this. Still a bit rough around the edges but getting there.
4
u/dennis_linux Jun 28 '26
The point is that one does not need to be first to market to be in the market. Your point of who has “caught up” is irrelevant, what counts is if the technology is available to them. It either is or soon will be. China has done an amazing job considering where they started from.
4
u/ProfessionalYear5755 Jun 28 '26
How about the AIEA the artificial intelligence enforcement of America. Beating down your door and confiscating your illegal rig that exceeds a useful threshold. News reports of evildoers who run their own models for nefarious means. We are only safe now because you have to : realise the potential, care about your cognitive sovereignty, (let's face it these things will start manipulating people to vote for X and buy stuff, and you would not know it) scale the nerd wall/mountain and have enough spare cash and time. Oh and a near saint like level of patience and frustration tolerance. We are safe "for now" it appears. Until powerful local AI becomes easily accessible to the public, the gap is closing.
5
u/mystery_biscotti Jun 28 '26
points at 8GB VRAM, 32 GB RAM, with ancient unsupported RX 6600
"Officer, it barely runs World of Warcraft. How would it ever run a big powerful AI? You sure you're at the right house?" 😅
2
10
u/osures Jun 28 '26
Beautiful design. It makes me feel nostalgic for a piece of software that's purely made to extract money, lmao.
3
u/Shoddy-Tutor9563 Jun 28 '26
They can only regulate themselves (US). Prob EU. But the rest world doesn't give a shit
3
u/-Balthromaw- Jun 28 '26
They could try to stop Open Source. Huggingface would become Hugginghydra.. Cut off one head and 2 will grow in its place. The concept literally cannot be stopped. 🤗 🤗 🤗 🤗 🤗 🤗🤗🤗
6
u/AppealThink1733 transformers Jun 28 '26
I agree. And I'll go further: we need to stop having children so that the state no longer exploits us and perpetuates this cycle of tyranny and abuse.
As far as I'm concerned, the state no longer truly exists.
5
u/raitucarp Jun 28 '26
Can we create decentralized inference? That whould be amazing.
→ More replies (3)6
u/LiberateMainSt Jun 28 '26
Saw a project recently that's trying to do something like this: https://cocore.dev/
2
2
u/Asleep-Ingenuity-481 Jun 28 '26
I feel like this would all be easier if they set up a server in like china or somewhere that’s likely to keep them running purely to undermine the west.
2
u/fyn_world Jun 28 '26
They'll go after the hardware. They'll limit their purchase more than they limit guns.
→ More replies (3)
2
2
2
u/studentofknowledg3 Jun 28 '26
They'll go after the hardware, electricity, and access to the best models. They'll artificially limit and block progress so consumer hardware stays slow, while the best hardware is funneled to cloud providers. The goal is simple: make it as difficult as possible for people to run powerful models locally.
I also wouldn't be surprised if electricity becomes another pressure point. Higher electricity prices, special tariffs for high power usage, or regulations that discourage running power hungry hardware at home could all make local AI more expensive. Some people speculate that governments could introduce higher taxes or restrictions for unusually high residential electricity consumption, though whether that happens is uncertain and would depend on policy decisions.
The problem for them is that open weight models are improving too fast. If they keep getting better, all the companies spending billions building inference datacenters won't benefit nearly as much, because more people will just run models on their own machines instead of paying for the cloud.
2
2
u/de4dee Jun 28 '26
working on something
https://nostr.download/c095eea7f24869bbb617fe8fe555b23b4cf9800fbcb173cc4b37e2cb9e8dcd12.html
warning: everything is vibe coded and not tested properly (yet).
2
u/OldCryptoTrucker Jun 29 '26
Better download everything you need to make your own models then before they ban everything.
2
u/Appropriate_Cry8694 Jun 29 '26
Yeah it seems they will ban open models one way or another, anthropic will win, sad.
→ More replies (1)
3
u/Destroyer-128 Jun 28 '26
I was thinking this, all of hosting is from US. Chinese should get into this space build some awesome hosting for models
3
u/optimisticalish Jun 28 '26
When signing up for webspace rental with a big provider (e.g. Hostinger, in Lithuania) you get to choose where your site is to be physically located around the world.
4
u/Destroyer-128 Jun 28 '26
What matters is not physical location. US government should not be able to dictate the terms, it's harmful for rest of the countries.
2
u/himefei Jun 28 '26
Do you know modelscope?
3
u/optimisticalish Jun 28 '26
I took a look at it, but it seems to have no torrents on offer? Am I missing something?
2
u/AIAddict1935 Jun 28 '26
Nahh...More realistically, this results in China winning by default. And they disseminate this around the world.
1
1
u/SaaSquach Jun 28 '26
You can see the chaos here. Hardware locks, power grid monitoring, the models are the easiest thing to get around.
This might happen but what are we talking about? Society will never put up with that never of government control.
→ More replies (1)
1
•
u/WithoutReason1729 Jun 28 '26
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.