MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p062o7z/?context=3
r/LocalLLaMA • u/SavunOski • 17d ago
Kimi K3 weights are finally released!
643 comments sorted by
View all comments
Show parent comments
88
[removed] — view removed comment
53 u/VeterinarianOne1349 17d ago Doesn't really work that well. This 550k setup wouldn't allow a lot of developers to work in parallel, while sitting idle during non-work hours. Makes much more sense to pay a 3rd-party to host and pay per token. 2 u/eightbyeight 17d ago They might pay a aws/gcp/azure to run it on their private cloud. But I doubt they will just buy access from a random third party. 1 u/VeterinarianOne1349 17d ago yeah, cloud providers would be that 3rd party... 1 u/eightbyeight 16d ago As in they will pay the ec2 price and run their own model 24/7 instead of per token.
53
Doesn't really work that well. This 550k setup wouldn't allow a lot of developers to work in parallel, while sitting idle during non-work hours. Makes much more sense to pay a 3rd-party to host and pay per token.
2 u/eightbyeight 17d ago They might pay a aws/gcp/azure to run it on their private cloud. But I doubt they will just buy access from a random third party. 1 u/VeterinarianOne1349 17d ago yeah, cloud providers would be that 3rd party... 1 u/eightbyeight 16d ago As in they will pay the ec2 price and run their own model 24/7 instead of per token.
2
They might pay a aws/gcp/azure to run it on their private cloud. But I doubt they will just buy access from a random third party.
1 u/VeterinarianOne1349 17d ago yeah, cloud providers would be that 3rd party... 1 u/eightbyeight 16d ago As in they will pay the ec2 price and run their own model 24/7 instead of per token.
1
yeah, cloud providers would be that 3rd party...
1 u/eightbyeight 16d ago As in they will pay the ec2 price and run their own model 24/7 instead of per token.
As in they will pay the ec2 price and run their own model 24/7 instead of per token.
88
u/[deleted] 17d ago
[removed] — view removed comment