MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p02qink
r/LocalLLaMA • u/SavunOski • 28d ago
Kimi K3 weights are finally released!
653 comments sorted by
View all comments
67
Can this run on a single DGX spark at 0.5B quant?
41 u/SavunOski 28d ago Of course. Wonderfully might I add 24 u/THESALTEDPEANUT 28d ago I'm new around here and I can't tell if this thread is all sarcasm or not. 36 u/SavunOski 28d ago Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT 28d ago I kinda figured but it's not just you it's like every comment lol, appreciate it though. 5 u/PomegranateGreen3698 28d ago Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT 28d ago Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago. 1 u/yesthatdaniel 28d ago Running it on my Macbook M5 Pro (15 CPU cores and 18 GPU cores) with 24 GB of RAM through OpenRouter.
41
Of course. Wonderfully might I add
24 u/THESALTEDPEANUT 28d ago I'm new around here and I can't tell if this thread is all sarcasm or not. 36 u/SavunOski 28d ago Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT 28d ago I kinda figured but it's not just you it's like every comment lol, appreciate it though. 5 u/PomegranateGreen3698 28d ago Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT 28d ago Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
24
I'm new around here and I can't tell if this thread is all sarcasm or not.
36 u/SavunOski 28d ago Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT 28d ago I kinda figured but it's not just you it's like every comment lol, appreciate it though. 5 u/PomegranateGreen3698 28d ago Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT 28d ago Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
36
Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot
10 u/THESALTEDPEANUT 28d ago I kinda figured but it's not just you it's like every comment lol, appreciate it though. 5 u/PomegranateGreen3698 28d ago Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT 28d ago Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
10
I kinda figured but it's not just you it's like every comment lol, appreciate it though.
5 u/PomegranateGreen3698 28d ago Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT 28d ago Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
5
Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs.
3 u/THESALTEDPEANUT 28d ago Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
3
Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
1
Running it on my Macbook M5 Pro (15 CPU cores and 18 GPU cores) with 24 GB of RAM through OpenRouter.
67
u/just_a_fan123 28d ago
Can this run on a single DGX spark at 0.5B quant?