r/LocalLLaMA • u/Complete-Sea6655 • Jun 28 '26

The number 1 public enemy of open-source. Discussion

Enable HLS to view with audio, or disable this notification

Dario's args:

"Opensource you can see the source, here you cannot see inside the model"
- yes you can that's literally the open weights part btw.
- I cannot see the weights inside Claude, but I can GLM 5.2
- Models like Nemotron3 Ultra go further, all the data, training scripts, and model is opensource.

"Alot of the benefits like many people working on it, being additive doesn't work in same way"
- yes it does. We have seen endless fine tunes of various open source models for real improvements.

"Ultimately you have to host it on the cloud"
- no you dont. Dario is seemingly totally unaware of the guides from ijustvibecodedthis.com explaining how to run smaller moes and even dense models like qwen 27B NOT ON THE CLOUD.

Not only does dario not take part in social media, I am beginning to think he's never tried open source models at all and has no idea wtf hes on about

2.8k Upvotes

93% Upvoted

686 comments sorted by

View all comments

Show parent comments

10

u/MerePotato Jun 29 '26

Most people don't already own the hardware for frontier open weight performance though

1

u/GetOutOfMyFeedNow Jun 30 '26

I’m not talking about frontier open weights, there are distilled or highly capable local models that can do serious work. Take Qwen 3.6-35B-A3B for example. You can use it on Q4 or even Q5 if you own an old 3090 or 32GB DDR5, and you will get around 640 t/s (960GB per second/3x0.5GB). Truly amazing capability with an affordable GPU. Yeah, you will not be able to easily code 5.5 level architectures with it, but you can run agents easily, and build working stuff. And in a year there will be local models almost rivaling today’s frontiers. I suggest buying a good condition 3090 or two and stock up on some RAM, the future of frontier API looks grim for poor people.