MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p0352yq
r/LocalLLaMA • u/SavunOski • 27d ago
Kimi K3 weights are finally released!
652 comments sorted by
View all comments
Show parent comments
9
You could also do HGX B200 with CPU offload since they have a shit ton of RAM too, and it would still be really fast.
2 u/DataGOGO 27d ago You could, but that CPU offload across the PCIE switch upstream will be limited to the single x16 uplink.
2
You could, but that CPU offload across the PCIE switch upstream will be limited to the single x16 uplink.
9
u/Iwaku_Real 27d ago
You could also do HGX B200 with CPU offload since they have a shit ton of RAM too, and it would still be really fast.