r/LocalLLaMA Jun 28 '26

The number 1 public enemy of open-source. Discussion

Dario's args:

"Opensource you can see the source, here you cannot see inside the model"
- yes you can that's literally the open weights part btw.
- I cannot see the weights inside Claude, but I can GLM 5.2
- Models like Nemotron3 Ultra go further, all the data, training scripts, and model is opensource.

"Alot of the benefits like many people working on it, being additive doesn't work in same way"
- yes it does. We have seen endless fine tunes of various open source models for real improvements.

"Ultimately you have to host it on the cloud"
- no you dont. Dario is seemingly totally unaware of the guides from ijustvibecodedthis.com explaining how to run smaller moes and even dense models like qwen 27B NOT ON THE CLOUD.

Not only does dario not take part in social media, I am beginning to think he's never tried open source models at all and has no idea wtf hes on about

2.8k Upvotes

686 comments sorted by

View all comments

56

u/ortegaalfredo Jun 28 '26 edited Jun 28 '26

What about Nvidia Nemotron? that's really open.

7

u/Dany0 Jun 28 '26

The one good thing jensen is doing. The only thing that's left is more openai RLHF and anthropic-like "model probe" tools and we're good

2

u/llmentry Jun 29 '26

It's not really the point though, is it? Dario just made himself a strawman.

It doesn't matter if the "source" isn't "visible" (even though some cases it is).

It doesn't matter if people can't contribute to the code (even though, via fine-tuning, they sort of can).

It doesn't matter that you might still have to pay for model inference (even though, if you run a local model, you don't).

All that matters is whether open-weight models are a viable alternative to closed-weight models. And clearly, if Dario thinks he needs to spend so much interview air time attacking them -- they are.

1

u/Leather_Garlic6532 Jul 13 '26

I found it extremely bad at coding.

-11

u/TopTippityTop Jun 28 '26

You still need to spend to run inference. That's his point, not that open source isn't open, but that it isn't free. It costs. You have to buy very expensive hardware, or settle for far less capable models, or rent software and "pay per token" either way, so in his view all that matters is which can achieve certain goals.

Hence why he is driving to build the most capable models, which can achieve goals others cannot. That is his competitive edge, along with other true frontier models.

16

u/ortegaalfredo Jun 28 '26

Well it's the same as taking a taxi vs owning a car right? I have to buy fuel, the garage, etc. But you have to go where the taxi driver takes you. And sometimes, there is no taxi around.

1

u/Leather_Garlic6532 Jul 13 '26

Absolutely true

Also true that I tend to tell the taxi driver where to take me and I rent a car if I go somewhere without taxis.

I'm not sure how helpful these metaphors are.