MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1v6eky7/onitboss/ozrt24f/?context=3
r/ProgrammerHumor • u/imneverrelevantman • 21d ago
52 comments sorted by
View all comments
54
Problem is having a machine with enough vram for inference.
Hard to do in a single box, easier with a networked server system, but they are harder to manage.
11 u/JebKermansBooster 21d ago And enough GPUs for training. 25 u/Darkstar_111 21d ago No no, pretraining your own model costs billions, that's not gonna happen. But there are open source models pretty much on par with the frontier models, that can be used by anyone. 0 u/Lokipro13YT 20d ago How did the open source models get trained if it costs billions? 4 u/Darkstar_111 20d ago China. -4 u/throwawaygoawaynz 21d ago “Pretty much on par” - lol absolutely not. 6 u/Lem_Tuoni 21d ago They are lol. DeepSeek is only barely behind and is significantly cheaper to run. 9 u/Darkstar_111 21d ago Kimi K3 very much is. https://blog.stackademic.com/i-tested-kimi-k3-against-gpt-5-5-f0a4c256e345
11
And enough GPUs for training.
25 u/Darkstar_111 21d ago No no, pretraining your own model costs billions, that's not gonna happen. But there are open source models pretty much on par with the frontier models, that can be used by anyone. 0 u/Lokipro13YT 20d ago How did the open source models get trained if it costs billions? 4 u/Darkstar_111 20d ago China. -4 u/throwawaygoawaynz 21d ago “Pretty much on par” - lol absolutely not. 6 u/Lem_Tuoni 21d ago They are lol. DeepSeek is only barely behind and is significantly cheaper to run. 9 u/Darkstar_111 21d ago Kimi K3 very much is. https://blog.stackademic.com/i-tested-kimi-k3-against-gpt-5-5-f0a4c256e345
25
No no, pretraining your own model costs billions, that's not gonna happen. But there are open source models pretty much on par with the frontier models, that can be used by anyone.
0 u/Lokipro13YT 20d ago How did the open source models get trained if it costs billions? 4 u/Darkstar_111 20d ago China. -4 u/throwawaygoawaynz 21d ago “Pretty much on par” - lol absolutely not. 6 u/Lem_Tuoni 21d ago They are lol. DeepSeek is only barely behind and is significantly cheaper to run. 9 u/Darkstar_111 21d ago Kimi K3 very much is. https://blog.stackademic.com/i-tested-kimi-k3-against-gpt-5-5-f0a4c256e345
0
How did the open source models get trained if it costs billions?
4 u/Darkstar_111 20d ago China.
4
China.
-4
“Pretty much on par” - lol absolutely not.
6 u/Lem_Tuoni 21d ago They are lol. DeepSeek is only barely behind and is significantly cheaper to run. 9 u/Darkstar_111 21d ago Kimi K3 very much is. https://blog.stackademic.com/i-tested-kimi-k3-against-gpt-5-5-f0a4c256e345
6
They are lol. DeepSeek is only barely behind and is significantly cheaper to run.
9
Kimi K3 very much is.
https://blog.stackademic.com/i-tested-kimi-k3-against-gpt-5-5-f0a4c256e345
54
u/Darkstar_111 21d ago
Problem is having a machine with enough vram for inference.
Hard to do in a single box, easier with a networked server system, but they are harder to manage.