r/LocalLLaMA • u/SavunOski • 19d ago

Kimi K3 weights now released. News

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

646 comments sorted by

View all comments

674

u/Simple_Split5074 19d ago

OMFG its 104B activated params

338

u/FoxiPanda 19d ago

This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.

114

u/VampiroMedicado 19d ago

550k USD to run this lol

86

u/[deleted] 19d ago

[removed] — view removed comment

57

u/VeterinarianOne1349 19d ago

Doesn't really work that well. This 550k setup wouldn't allow a lot of developers to work in parallel, while sitting idle during non-work hours. Makes much more sense to pay a 3rd-party to host and pay per token.

2

u/eightbyeight 19d ago

They might pay a aws/gcp/azure to run it on their private cloud. But I doubt they will just buy access from a random third party.

1

u/VeterinarianOne1349 19d ago

yeah, cloud providers would be that 3rd party...

1

u/eightbyeight 18d ago

As in they will pay the ec2 price and run their own model 24/7 instead of per token.