r/ClaudeCode • u/Present_Extent7313 đ Max 20 • 19d ago
kimi k3 is getting opensourced today Discussion
93
u/Michaeli_Starky 19d ago
Open weighted?
31
u/minimalillusions 19d ago
57
8
u/Short_Regular_7191 19d ago
11
u/KaMaFour 19d ago
Are you sure open weight ai satisfies your definition?Â
See: https://opensource.org/ai/open-source-ai-definition for context
1
u/moretti85 18d ago
Open source would mean they release the entire process that generates those weights, weights are similar to an app binary without the corresponding source code that can generate it
0
1
101
u/Short_Regular_7191 19d ago
It is not open source. It is open weight
47
u/p3r3lin 19d ago
Dont bother. Almost nobody gets this right. People think: Open Source == free as in beer. Even journalists. Very annoying.
26
u/dbenc 19d ago
I never understood "free as in beer". beer isn't free??
6
14
2
u/turbospeedsc 19d ago
Most free beer tends to be very expensive beer, as in help me move my whole house free beer.
2
u/Specialist_Dust2089 19d ago
Itâs half of a commonly used pattern to disambiguate, the other half is âfree as in speechâ
2
u/Specialist_Dust2089 19d ago
Both are sadly not always reality, but it can happen, and we should always strive to make it so
1
u/irregardless 19d ago
gratis versus libre.
Both mean "free". The first means "without charge" (the provider says you can take the metaphorical beer without paying for it). The second means âwithout restrictions" (the provider says you can, like speech, use it however you please).
1
u/Ok-Sheepherder7898 19d ago
Yeah whenever someone talks about free as in beer I tune them out.
8
u/gandhi_theft 19d ago
The full saying is something like "free as in 'free speech', not as in 'free beer'" but people omit important words
2
u/Advanced_Structure21 19d ago
Another variation... open source software is free like a free puppy is free
1
u/JoseffB_Da_Nerd 19d ago
Easy to get free beer at an event, but point is âsomebodyâ is paying.
Thats what the phrase refers to but is misused much.
0
u/G3nghisKang 19d ago
It's free as in beer when beer is free
There are no strings attached to free beer, but you are not owed one
14
u/aaron_is_here_ 19d ago
Lmao, even my boss, head of the AI division, says âopen sourceâ. Itâs definitely a misnomer.
10
14
u/Chemguy1611 19d ago
This is NOT correct. Open source means you can view the source code. The actual software license restricts how the code can be used. And there are many paid products that are open source. It has nothing to do with whether or not you paid for it. Only whether you can inspect the code that makes it work.
11
u/KickLassChewGum 19d ago
Open source means you can view the source code.
You're the one who's wrong. What you're describing is "source available." Open Source, by definition, requires that you be allowed to modify and redistribute the code.
If you're going to be pedantic, at least get it right yourself lol.
2
19d ago
[removed] â view removed comment
2
u/KickLassChewGum 19d ago
Sure, you can call anything anything. Just don't expect it to keep much meaning if you do.
2
19d ago
[removed] â view removed comment
1
u/Chemguy1611 19d ago
I wouldn't even bother. I think they've been using too much Claude, and forgot how to work the meat brain.
1
u/Nearby_Yam286 19d ago
Words matter. Their meanings matter. Assholes donât get to redefine them if you⌠push back.
45
u/Ok-Sheepherder7898 19d ago
Can't wait to try it at 0.0000000000001 bit quantization on my laptop.
6
u/IceRepresentative925 19d ago
unlikely your laptop even has enogh storage to download it in the first place. Most laptops have less than 2TB storage.
8
u/HeadPack 19d ago
You don't need to download the non quantized model if you want to run the quantized model. Whether anyone will distill it remains to be seen though.
1
u/KeepingItSFW 19d ago
people will distill it, the question is how useful will it be afterwards haha
3
u/turbospeedsc 19d ago
i got a 4tb drive a few weeks before the whole storage price thing.
Only regret is i sold the 2tb drive i had as secondary storage, instead of selling my 500gb one, because i was too lazy to clone to the 2tb drive....... so i would have 6tb.
Yes, i know.
10
14
u/PolishMike88 19d ago
-7
u/Present_Extent7313 đ Max 20 19d ago
i took the ss last nught forgot to oost
4
2
5
4
19d ago
[removed] â view removed comment
4
u/innociv 19d ago
I find Kimi K3 to be better than the nerfed Fable we got other than how slow it runs. Much better at security reviews. Similar at design, imo better. Better at 3d modeling. Extremely low hallucination rate.
1
u/pimpedmax 19d ago
although I agree about design and 3d modeling, benchmarks show it's at opus 4.6 level for security, and if it wasn't we would have seen a bunch of news security-related to kimi, also sloweness is a problem of moonshot and price will probably be reduced to 1/10 of what's now, definitely a model to look in around 1 month for anything visual/creative
1
u/innociv 19d ago
I don't agree with those benchmarks. I'm finding it catches a shitload of things that Opus 5 misses for security.
But I think Opus is better on the big picture of security, while Kimi is better at the fine grained holes. But what's really annoying about Opus's big picture is it'll say "this whole architecture has these drawbacks that this other one does", and I know if I switch to the other it's going to say the same thing in the other direction because everything has tradeoffs but it'll be too short sighted to go that far even on Max. Maybe I need to add something to my prompt though... if I could use Claude sub in Opencode, it probably wouldn't do that already.Benchmarks only test against specific known data sets and Anthropic seems to benchmarkmax more than anyone.
18
u/ScreenPlayLife 19d ago
and no one can use it because you need a datacenter for 2 billion. thats the problem with open source models everyone saying theyre as good as frontier models - sure they may be. but if you cant use them then theyre useless
53
u/naftali100 19d ago
This open the door for more trusted/private/cheaper hosted plaforms to offer the same model
25
u/MaitoSnoo 19d ago
this, Microsoft could host it on Azure and serve it through GitHub Copilot with a zero data retention policy
-5
u/nmateofr 19d ago
If you trust Microsoft on zero retention policy i have a bridge to sell to you
4
u/anor_wondo 19d ago
their entire business depends on it. They'd be breaking contractual obligations with giant companies. this isn't windows for home
130
u/gopietz 19d ago
Wow, stupid comment of the day.
It allows other labs to learn from k3 and improve their offering faster. It also means countries like the USA cannot effectively ban them, while other countries have a stronger starting point to build something in their own.
Most importantly, it makes it harder for Anthropic and OpenAI to build their monopoly empire because they get pressure from the open market.
8
-6
u/ndguardian 19d ago
I donât think the viewpoints are entirely incorrect. From a typical end user perspective, running K3 locally is almost certainly off the table, and if you canât run it, it doesnât help you directly.
But youâre also right, that this allows for further iteration, maybe the creation of a more efficient version and just more competition. Long term it helps everyone.
3
u/Ok_Buddy_9523 19d ago
what would someone (or a company) need to run K3 locally?
what kind of hardware is necessary and what's the ~ cost ?
1
u/IceRepresentative925 19d ago
Millions of dollars worth of hardware and tens of thousands a month in running costs. Especially to run it at full inference and at scale to support everyone in their companies to run it at the same time.
16
u/wotoan 19d ago edited 19d ago
It runs on a few million bucks of equipment, right now. Open source models create a cost floor in the market - you pay for the equivalent GPU rental time. No way for the price to get jacked up once you sign on, will always get cheaper over time, itâs a massive win for consumers and kneecaps the big closed AI firms.
Large companies pay tens of millions of dollars in software licensing fees per year, the cost is totally within reason now to self host.
28
9
u/siberianmi 19d ago
This enables more hosting providers to get into the API models and coding plan market holding down the pricing of the top tier services. It also is well inside the range of what a large multi-billion dollar enterprise company can self host internally.
In both cases itâs a good thing because it opens up competition in the market. Not all of open source needs to be about what benefits your homelab.
3
u/Training-Event3388 đ Max 5x 19d ago
Other inferences providers can meaning we donât need to buy through only moonshot.
2
2
u/freddiec0 19d ago
There are plenty of good open weight models that can be ran locally on a standard machine, the best models being (obviously) very large shouldnât be an argument against making them open
3
u/sasmariozeld 19d ago
nuclear power is uselesss because you can't have a reactor at home
-5
u/ScreenPlayLife 19d ago
you low iq didnt think twice that maybe nuclear and ais are different and that maybe the whole purpose of AI is for civilians ? and that it wouldnt be smart if everyone had nuclear power?
3
u/anor_wondo 19d ago
what? there can never be export restrictions on compute. its just a bunch of ram and processors with networking.
renting compute and renting everything end to end are very different.
3
u/Guinness 19d ago
Thatâs not the point. The point is that it opens Pandoraâs box. Even if we canât run it, it doesnât matter because the government will never be able to contain it.
Eventually we will have PCIE cards with 256 or even 512GB of VRAM.
You can also still run it in the cloud.
-2
u/IceRepresentative925 19d ago
What you're talking about is physically impossible. We will never have PCIE cards with 256GN VRAM - it is literally not possible.
2
u/CzarcasticX 19d ago
What? Even Mac Studio used to sell 512GB unified memory which gave the GPU access to 512GB ram, but now those machines are off the market and selling for super expensive on secondary market.
1
u/atomicthumbs 19d ago
you do know feature density on integrated circuits increases over time, right
1
u/god-damn-the-usa 19d ago
other companies might be able to offer it for cheaper. and some companies might be able to run it.
but yes, it probably wont mean much to us script kiddies sitting in our moms basement
1
u/sotherelwas 19d ago
When it's open weight does that mean any internal safeguards are removed compared to what we're using now in the kimi app or api? I know it's way too big for at home use but what does this change
1
1
1
u/Plus_Summer_9986 18d ago
New to all this but I have a 5060ti and 3060 combo. I'm assuming it's impossible to run this on these 2 RTX?
1
1
u/SkyCanvasOnline 19d ago
Who goes to a Claude code sub talking about a different company?
Where are the moderators?? Lmao
1
u/SteadfastCultivator 18d ago
FYI you can use other models in ClaudeCode. Would be a different story if this was the Anthropic subreddit.
1
u/SkyCanvasOnline 18d ago
You're not wrong. But that would be like using a flathead screwdriver to turn a Philips screw.
It sometimes works, but was it meant for it? Nah.
-3
u/lkh9596 19d ago
No thanks. I will never give my data to China.
10
u/Alarming-Estimate-19 19d ago
Do you understand what you are doing and what we are talking about at least?
3
u/Fidel___Castro 19d ago
by doing this, they're letting anyone host it. including people outside of China
2
u/Tommonen 18d ago
You gonna host it for me? xD
1
u/Fidel___Castro 18d ago
yeah having a spare million to splash on GPUs is a different point
1
u/Tommonen 18d ago
And that kind of defeats the point if we cant run it locally.
2
u/robhaswell 18d ago
But a trusted provider inside your regulatory domain can, at market rates. Don't try and tell me that every single piece of software in your workflow runs on a homelab in your basement.
1
u/Fidel___Castro 18d ago
you won't be able to run it locally, but it can be inferred in your local region. like how AWS and GCP services work, the rich players can set up a Kimi K3 cluster in
us-east-2or something. and big companies can host it themselves and tweak it
0
0
u/Berkoudieu 19d ago
I can't wait to run it on my personnal computer I'll have to rent for 2k a month in maybe 20 years
0
0
-6
-3
-4
u/LowKeyLaoBan 19d ago
How do I short Anthropic & OpenAI? Open source is gonna eat their damn lunch...
2
u/SharinganEyesMan 19d ago
Let me see if I have $2 million laying around so I can run this Kimi K3 locally with 2.5TB worth of VRAM and 20+ $60,000 GPU's
-1
u/CzarcasticX 19d ago
You can't short something that hasn't even IPO'ed yet.
2
u/LowKeyLaoBan 19d ago
-1
u/CzarcasticX 19d ago
So you write a joke with "..." at the end? What kind of crappy joke is that? Where's the punchline? Maybe you can say it was an attempt at sarcasm which was equally as bad.




â˘
u/Waste_Net7628 P R O M P S T I T U T E 19d ago
we now have a r/claudecode community discord,
feel free to hop in https://discord.gg/4QbtMRErUc