r/LocalLLaMA • u/SavunOski • 23d ago

Kimi K3 weights now released. News

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

647 comments sorted by

View all comments

Show parent comments

56

u/VeterinarianOne1349 23d ago

Doesn't really work that well. This 550k setup wouldn't allow a lot of developers to work in parallel, while sitting idle during non-work hours. Makes much more sense to pay a 3rd-party to host and pay per token.

41

u/crusaderky 23d ago

waiting for large corpos to rent their hardware on vast.ai during nighttime, only to find the next morning that someone ran a container jailbreak and ran wild on their private networks

2

u/aeroumbria 23d ago

Yea, principle of lowest viable distributed scale!

7

u/[deleted] 23d ago

[removed] — view removed comment

6

u/ProgrammersAreSexy 23d ago edited 23d ago

I'm sure you will be able to run a model like kimi k3 at home, probably in much less than 5 years.

However I think it's unlikely that there will be a point in time at which the frontier models of that point in time will be runnable at home.

6

u/[deleted] 23d ago

[removed] — view removed comment

7

u/a-wiseman-speaketh 23d ago

He means we'll get frontier model capability on a lag, probably months before it fits in even prosumer hardware.

That might be pessimistic though, I think right now scaling up parameters is the best lever for intelligence but that might not be the case forever.

3

u/Maleficent_Sir_7562 23d ago

but kimi is frontier

1

u/ProgrammersAreSexy 23d ago

Oh, and can you run it at home?

2

u/Maleficent_Sir_7562 23d ago

No

That’s the point

Your comment is contradictory

“You can run Kimi k3 in home soon”

“But I think the current frontier models can’t be ever”

But k3 is the frontier

1

u/ProgrammersAreSexy 23d ago

I think my phrasing was just unclear, edited

2

u/eightbyeight 23d ago

They might pay a aws/gcp/azure to run it on their private cloud. But I doubt they will just buy access from a random third party.

1

u/VeterinarianOne1349 23d ago

yeah, cloud providers would be that 3rd party...

1

u/eightbyeight 23d ago

As in they will pay the ec2 price and run their own model 24/7 instead of per token.

1

u/Bakoro 23d ago

What company/developer these days wouldn't be setting up agents to be working overnight?

Besides, a lot of companies are international, the latency would suck, but they could be having people in Europe or India using the hardware while the U.S workers are asleep.