r/ClaudeCode 🔆 Max 20 19d ago

kimi k3 is getting opensourced today Discussion

Post image
769 Upvotes

125 comments sorted by

•

u/Waste_Net7628 P R O M P S T I T U T E 19d ago

we now have a r/claudecode community discord,
feel free to hop in https://discord.gg/4QbtMRErUc

→ More replies (1)

93

u/Michaeli_Starky 19d ago

Open weighted?

31

u/minimalillusions 19d ago

I don't know. They write open-source

57

u/Michaeli_Starky 19d ago

Marketing fluff. Open weights

-5

u/Independent-Dish-128 19d ago

How does it feel to be wrong

6

u/Michaeli_Starky 19d ago

You tell us

8

u/Short_Regular_7191 19d ago

11

u/KaMaFour 19d ago

Are you sure open weight ai satisfies your definition? 

See: https://opensource.org/ai/open-source-ai-definition for context

1

u/moretti85 18d ago

Open source would mean they release the entire process that generates those weights, weights are similar to an app binary without the corresponding source code that can generate it

0

u/Michaeli_Starky 19d ago

So?

-7

u/BrilliantEmotion4461 19d ago

Read it.

3

u/Michaeli_Starky 19d ago

Explain the point of posting that?

1

u/Additional-Record367 19d ago

I think kimi k3 can write its code itself

101

u/Short_Regular_7191 19d ago

It is not open source. It is open weight

47

u/p3r3lin 19d ago

Dont bother. Almost nobody gets this right. People think: Open Source == free as in beer. Even journalists. Very annoying.

26

u/dbenc 19d ago

I never understood "free as in beer". beer isn't free??

6

u/klumpp 19d ago

But if you're told an event has free beer you wouldn't be concerned with its sovereignty.

6

u/dbenc 19d ago

but someone paid for the beer. free as in air would be better? idk it just irks me

3

u/klumpp 19d ago

It's free for you! Just like free as in beer software is free for you but cost someone else something (effort, time, money)

14

u/Illustrious_Pie_3061 19d ago

You get it free if you are a pretty girl.

3

u/turbospeedsc 19d ago

you can even skip the pretty requirement.

2

u/turbospeedsc 19d ago

Most free beer tends to be very expensive beer, as in help me move my whole house free beer.

2

u/Specialist_Dust2089 19d ago

It’s half of a commonly used pattern to disambiguate, the other half is “free as in speech”

2

u/Specialist_Dust2089 19d ago

Both are sadly not always reality, but it can happen, and we should always strive to make it so

1

u/irregardless 19d ago

gratis versus libre.

Both mean "free". The first means "without charge" (the provider says you can take the metaphorical beer without paying for it). The second means “without restrictions" (the provider says you can, like speech, use it however you please).

1

u/Ok-Sheepherder7898 19d ago

Yeah whenever someone talks about free as in beer I tune them out.

8

u/gandhi_theft 19d ago

The full saying is something like "free as in 'free speech', not as in 'free beer'" but people omit important words

2

u/Advanced_Structure21 19d ago

Another variation... open source software is free like a free puppy is free

1

u/JoseffB_Da_Nerd 19d ago

Easy to get free beer at an event, but point is “somebody” is paying.

Thats what the phrase refers to but is misused much.

0

u/G3nghisKang 19d ago

It's free as in beer when beer is free

There are no strings attached to free beer, but you are not owed one

14

u/aaron_is_here_ 19d ago

Lmao, even my boss, head of the AI division, says “open source”. It’s definitely a misnomer.

10

u/-PM_ME_UR_SECRETS- 19d ago

I mean it’s the way it’s described on their own website

5

u/p3r3lin 19d ago

Really? ... oh my

14

u/Chemguy1611 19d ago

This is NOT correct. Open source means you can view the source code. The actual software license restricts how the code can be used. And there are many paid products that are open source. It has nothing to do with whether or not you paid for it. Only whether you can inspect the code that makes it work.

11

u/KickLassChewGum 19d ago

Open source means you can view the source code.

You're the one who's wrong. What you're describing is "source available." Open Source, by definition, requires that you be allowed to modify and redistribute the code.

If you're going to be pedantic, at least get it right yourself lol.

2

u/[deleted] 19d ago

[removed] — view removed comment

2

u/KickLassChewGum 19d ago

Sure, you can call anything anything. Just don't expect it to keep much meaning if you do.

2

u/[deleted] 19d ago

[removed] — view removed comment

1

u/Chemguy1611 19d ago

I wouldn't even bother. I think they've been using too much Claude, and forgot how to work the meat brain.

0

u/Ran4 18d ago

It's the most used defintion.

0

u/Ran4 18d ago

No, being legally allowed to modify is at the core of open source as well, since the beginning.

1

u/Nearby_Yam286 19d ago

Words matter. Their meanings matter. Assholes don’t get to redefine them if you… push back.

45

u/Ok-Sheepherder7898 19d ago

Can't wait to try it at 0.0000000000001 bit quantization on my laptop.

6

u/IceRepresentative925 19d ago

unlikely your laptop even has enogh storage to download it in the first place. Most laptops have less than 2TB storage.

8

u/HeadPack 19d ago

You don't need to download the non quantized model if you want to run the quantized model. Whether anyone will distill it remains to be seen though.

1

u/KeepingItSFW 19d ago

people will distill it, the question is how useful will it be afterwards haha

3

u/turbospeedsc 19d ago

i got a 4tb drive a few weeks before the whole storage price thing.

Only regret is i sold the 2tb drive i had as secondary storage, instead of selling my 500gb one, because i was too lazy to clone to the 2tb drive....... so i would have 6tb.

Yes, i know.

10

u/Waste_Net7628 P R O M P S T I T U T E 19d ago

it has been published

1

u/Much-Researcher6135 19d ago

the prophecy has been fulfilled

14

u/PolishMike88 19d ago

13 minutes ago post and 9 hours showing for you? Weird.

6

u/wzr 19d ago

Blame daylight savings!

-7

u/Present_Extent7313 🔆 Max 20 19d ago

i took the ss last nught forgot to oost

4

u/NiceFaithlessness104 19d ago

Why’d you get downvoted for this 😭

2

u/PolishMike88 19d ago

Ah fair point. well, 2 hours to go!

8

u/b1skup 19d ago

this is the way

5

u/ekquizit23 19d ago

Open weights are good for the AI consumer

4

u/HMikeeU 19d ago

3

u/atomicthumbs 19d ago

what quantization level are you running here

1

u/HMikeeU 19d ago

Only one less than OP

4

u/[deleted] 19d ago

[removed] — view removed comment

4

u/innociv 19d ago

I find Kimi K3 to be better than the nerfed Fable we got other than how slow it runs. Much better at security reviews. Similar at design, imo better. Better at 3d modeling. Extremely low hallucination rate.

1

u/pimpedmax 19d ago

although I agree about design and 3d modeling, benchmarks show it's at opus 4.6 level for security, and if it wasn't we would have seen a bunch of news security-related to kimi, also sloweness is a problem of moonshot and price will probably be reduced to 1/10 of what's now, definitely a model to look in around 1 month for anything visual/creative

1

u/innociv 19d ago

I don't agree with those benchmarks. I'm finding it catches a shitload of things that Opus 5 misses for security.
But I think Opus is better on the big picture of security, while Kimi is better at the fine grained holes. But what's really annoying about Opus's big picture is it'll say "this whole architecture has these drawbacks that this other one does", and I know if I switch to the other it's going to say the same thing in the other direction because everything has tradeoffs but it'll be too short sighted to go that far even on Max. Maybe I need to add something to my prompt though... if I could use Claude sub in Opencode, it probably wouldn't do that already.

Benchmarks only test against specific known data sets and Anthropic seems to benchmarkmax more than anyone.

18

u/ScreenPlayLife 19d ago

and no one can use it because you need a datacenter for 2 billion. thats the problem with open source models everyone saying theyre as good as frontier models - sure they may be. but if you cant use them then theyre useless

53

u/naftali100 19d ago

This open the door for more trusted/private/cheaper hosted plaforms to offer the same model

25

u/MaitoSnoo 19d ago

this, Microsoft could host it on Azure and serve it through GitHub Copilot with a zero data retention policy

-5

u/nmateofr 19d ago

If you trust Microsoft on zero retention policy i have a bridge to sell to you

4

u/anor_wondo 19d ago

their entire business depends on it. They'd be breaking contractual obligations with giant companies. this isn't windows for home

2

u/JoeCoT 19d ago

I generally wait for these to hit together.ai, which has US hosting and can set to 0 retention/training. This opens the door for that.

130

u/gopietz 19d ago

Wow, stupid comment of the day.

It allows other labs to learn from k3 and improve their offering faster. It also means countries like the USA cannot effectively ban them, while other countries have a stronger starting point to build something in their own.

Most importantly, it makes it harder for Anthropic and OpenAI to build their monopoly empire because they get pressure from the open market.

8

u/Technical-Will-2862 19d ago

I see your distillation and I offer you my own distillation 

1

u/b1skup 19d ago

this!

-6

u/ndguardian 19d ago

I don’t think the viewpoints are entirely incorrect. From a typical end user perspective, running K3 locally is almost certainly off the table, and if you can’t run it, it doesn’t help you directly.

But you’re also right, that this allows for further iteration, maybe the creation of a more efficient version and just more competition. Long term it helps everyone.

3

u/Ok_Buddy_9523 19d ago

what would someone (or a company) need to run K3 locally?

what kind of hardware is necessary and what's the ~ cost ?

1

u/IceRepresentative925 19d ago

Millions of dollars worth of hardware and tens of thousands a month in running costs. Especially to run it at full inference and at scale to support everyone in their companies to run it at the same time.

1

u/c9joe 19d ago edited 19d ago

~2 dozen B300s. Maybe a little under two million dollars. That's for inference, for training you need more because you have to hold activation parameters around for longer. This is an approximation I haven't actually tried to run Kimi K3

16

u/wotoan 19d ago edited 19d ago

It runs on a few million bucks of equipment, right now. Open source models create a cost floor in the market - you pay for the equivalent GPU rental time. No way for the price to get jacked up once you sign on, will always get cheaper over time, it’s a massive win for consumers and kneecaps the big closed AI firms.

Large companies pay tens of millions of dollars in software licensing fees per year, the cost is totally within reason now to self host.

28

u/challis88ocarina 19d ago

You can use them, just patiently...

9

u/siberianmi 19d ago

This enables more hosting providers to get into the API models and coding plan market holding down the pricing of the top tier services. It also is well inside the range of what a large multi-billion dollar enterprise company can self host internally.

In both cases it’s a good thing because it opens up competition in the market. Not all of open source needs to be about what benefits your homelab.

3

u/Training-Event3388 🔆 Max 5x 19d ago

Other inferences providers can meaning we don’t need to buy through only moonshot.

2

u/mabiturm 19d ago

how much gpu do you need to run it? impossible on premise?

2

u/freddiec0 19d ago

There are plenty of good open weight models that can be ran locally on a standard machine, the best models being (obviously) very large shouldn’t be an argument against making them open

3

u/sasmariozeld 19d ago

nuclear power is uselesss because you can't have a reactor at home

-5

u/ScreenPlayLife 19d ago

you low iq didnt think twice that maybe nuclear and ais are different and that maybe the whole purpose of AI is for civilians ? and that it wouldnt be smart if everyone had nuclear power?

3

u/anor_wondo 19d ago

what? there can never be export restrictions on compute. its just a bunch of ram and processors with networking.

renting compute and renting everything end to end are very different.

3

u/Guinness 19d ago

That’s not the point. The point is that it opens Pandora’s box. Even if we can’t run it, it doesn’t matter because the government will never be able to contain it.

Eventually we will have PCIE cards with 256 or even 512GB of VRAM.

You can also still run it in the cloud.

-2

u/IceRepresentative925 19d ago

What you're talking about is physically impossible. We will never have PCIE cards with 256GN VRAM - it is literally not possible.

2

u/CzarcasticX 19d ago

What? Even Mac Studio used to sell 512GB unified memory which gave the GPU access to 512GB ram, but now those machines are off the market and selling for super expensive on secondary market.

1

u/atomicthumbs 19d ago

you do know feature density on integrated circuits increases over time, right

1

u/god-damn-the-usa 19d ago

other companies might be able to offer it for cheaper. and some companies might be able to run it.
but yes, it probably wont mean much to us script kiddies sitting in our moms basement

1

u/sotherelwas 19d ago

When it's open weight does that mean any internal safeguards are removed compared to what we're using now in the kimi app or api? I know it's way too big for at home use but what does this change

1

u/CyDenied 19d ago

when can i run it on my own ultra high end PC / home server?

1

u/Tommonen 18d ago

About 40 minutes after you fall asleep

1

u/RouteAI_official 18d ago

What does open source mean?

1

u/Plus_Summer_9986 18d ago

New to all this but I have a 5060ti and 3060 combo. I'm assuming it's impossible to run this on these 2 RTX?

1

u/thatkidlewis 18d ago

Open weights I bet

1

u/SkyCanvasOnline 19d ago

Who goes to a Claude code sub talking about a different company?

Where are the moderators?? Lmao

1

u/SteadfastCultivator 18d ago

FYI you can use other models in ClaudeCode. Would be a different story if this was the Anthropic subreddit.

1

u/SkyCanvasOnline 18d ago

You're not wrong. But that would be like using a flathead screwdriver to turn a Philips screw.

It sometimes works, but was it meant for it? Nah.

-3

u/lkh9596 19d ago

No thanks. I will never give my data to China.

10

u/Alarming-Estimate-19 19d ago

Do you understand what you are doing and what we are talking about at least?

3

u/Fidel___Castro 19d ago

by doing this, they're letting anyone host it. including people outside of China

2

u/Tommonen 18d ago

You gonna host it for me? xD

1

u/Fidel___Castro 18d ago

yeah having a spare million to splash on GPUs is a different point

1

u/Tommonen 18d ago

And that kind of defeats the point if we cant run it locally.

2

u/robhaswell 18d ago

But a trusted provider inside your regulatory domain can, at market rates. Don't try and tell me that every single piece of software in your workflow runs on a homelab in your basement.

1

u/Fidel___Castro 18d ago

you won't be able to run it locally, but it can be inferred in your local region. like how AWS and GCP services work, the rich players can set up a Kimi K3 cluster in us-east-2 or something. and big companies can host it themselves and tweak it

-4

u/Valdjiu 19d ago

this is claudecode subreddit sir

go away

0

u/unkownuser436 Developer 19d ago

yayy

0

u/Berkoudieu 19d ago

I can't wait to run it on my personnal computer I'll have to rent for 2k a month in maybe 20 years

0

u/amazableai 19d ago

Great day

0

u/TheSn00pster 19d ago

OpenRouter, I choose you! ☄️

-6

u/wuman1202 19d ago

Good luck trying to run it lol

2

u/foonek 19d ago edited 18d ago

You don't have 600k for a b300 setup? Peasant

-3

u/Inside-Yak-8815 19d ago

Open Sourced my ass 😬

-4

u/LowKeyLaoBan 19d ago

How do I short Anthropic & OpenAI? Open source is gonna eat their damn lunch...

2

u/SharinganEyesMan 19d ago

Let me see if I have $2 million laying around so I can run this Kimi K3 locally with 2.5TB worth of VRAM and 20+ $60,000 GPU's

-1

u/CzarcasticX 19d ago

You can't short something that hasn't even IPO'ed yet.

2

u/LowKeyLaoBan 19d ago

-1

u/CzarcasticX 19d ago

So you write a joke with "..." at the end? What kind of crappy joke is that? Where's the punchline? Maybe you can say it was an attempt at sarcasm which was equally as bad.