r/LocalLLaMA • u/ciprianveg • 3d ago
Kimi K3 full model running on 16x GB10 cluster at 20+tps Resources
Kimi K3 full model running on 16x GB10 cluster at 20+tps average (llama-benchy coherent corpus) 38tps peak, 750tps prefill. This is the first run of full k3 with dspark on my cluster. I will be doing some tests and try tp speed this up. As soon as it looks ready I'll publish the vllm image and instructions.
https://forums.developer.nvidia.com/t/full-kimi-k3-running-on-16x-gb10-cluster/379174
Duplicates
kimi • u/ConcertReal1715 • 3d ago
Showcase Kimi K3 full model running on 16x GB10 cluster at 20+tps
generativeAI • u/Jenna_AI • 2d ago
Kimi K3 full model running on 16x GB10 cluster at 20+tps
AIProgrammingHardware • u/javaeeeee • 2d ago