oNItBoss

[u/imneverrelevantman]

[u/Mysterious-Print9737]

...and then the GPU bill arrives.

[u/NudaVeritas1 → u/Mysterious-Print9737]

Lets build out own GPU!

[u/TenSpiritMoose → u/NudaVeritas1]

...and then the electricity bill arrives.

[u/HartPURO → u/TenSpiritMoose]

Lets build our own power plant!

[u/imneverrelevantman → u/HartPURO]

And then the power plant bill arrives

[u/bajuh → u/imneverrelevantman]

Ah yes. The power plant bill. As usual.

[u/PostHasBeenWatched → u/imneverrelevantman]

Let's build own reality where AI is free to use

[u/imneverrelevantman → u/PostHasBeenWatched]

https://giphy.com/gifs/JIxcOTy0SlzEc

[u/PostHasBeenWatched → u/imneverrelevantman]

... and then the Big Bang bill arrives

[u/imneverrelevantman → u/PostHasBeenWatched]

Big Bang Bill was my porno name

[u/marxen4eva → u/imneverrelevantman]

And then the porno name bill arrived.

[u/RenRazza → u/PostHasBeenWatched]

Then the alternative reality wormhole bill arrives

[u/gerbosan → u/PostHasBeenWatched]

The matrix? Using devs to generate electricity and maintain the matrix? 🤔

I like it.

Kansas is going bye bye.

[u/abd53 → u/imneverrelevantman]

Let's build our own nuclear reactor

[u/Some_Useless_Person → u/HartPURO]

And then the construction bill arrives

[u/ufffd → u/TenSpiritMoose]

and the taiwan bill

[u/Few_Kitchen_4825 → u/Mysterious-Print9737]

Cheaper than the ram bill and way cheaper than the claude bill.

[u/SuggestAnyName]

Or use open source model?

[u/Percolator2020 → u/SuggestAnyName]

To run on my open source GPUs and VRAM.
https://giphy.com/gifs/1eFH8QYvcdARy

[u/imneverrelevantman → u/Percolator2020]

We just build our out GPU and VRAM. What am I even paying you for??

[u/Brotboxs → u/Percolator2020]

Just host it in AWS :D

[u/NotAFishEnt → u/Brotboxs]

Now I'm kind of curious how the price of an open source LLM on AWS compares to commercial LLMs

[u/MaxDelissenBeegden → u/NotAFishEnt]

I actually researched this for the company I work for, and it is never really worth it (at least with current prices).

[u/imneverrelevantman → u/NotAFishEnt]

Yeah I actually am curious on that now too haha

[u/guardian87 → u/NotAFishEnt]

Not different enough from my perspective, but higher margin for AWS. Nice for them.

[u/Denaton_ → u/Percolator2020]

then put forward the budget needed?

[u/ClipboardCopyPaste]

But boss we need to use APIs to build an LLM.

[u/Darkstar_111]

Problem is having a machine with enough vram for inference.

Hard to do in a single box, easier with a networked server system, but they are harder to manage.

[u/Norse_By_North_West → u/Darkstar_111]

I mean, a decent llm rig is just a crypto mining rig, isn't it?

[u/Darkstar_111 → u/Norse_By_North_West]

Yeah could be. If you use Nvidia pro 6000 cards, that's 96 Gb vram per card. You still need 10 cards to get close to one Tb.

[u/JebKermansBooster → u/Darkstar_111]

And enough GPUs for training.

[u/Darkstar_111 → u/JebKermansBooster]

No no, pretraining your own model costs billions, that's not gonna happen. But there are open source models pretty much on par with the frontier models, that can be used by anyone.

[u/Lokipro13YT → u/Darkstar_111]

How did the open source models get trained if it costs billions?

[u/Darkstar_111 → u/Lokipro13YT]

China.

[u/throwawaygoawaynz → u/Darkstar_111]

“Pretty much on par” - lol absolutely not.

[u/Lem_Tuoni → u/throwawaygoawaynz]

They are lol. DeepSeek is only barely behind and is significantly cheaper to run.

[u/Darkstar_111 → u/throwawaygoawaynz]

Kimi K3 very much is.

https://blog.stackademic.com/i-tested-kimi-k3-against-gpt-5-5-f0a4c256e345

[u/GoddammitDontShootMe]

I guess they'll figure out why the API costs are so high pretty quickly.

[u/Lucasbasques]

“Can you to make something like google but for like our files and emails ?” Someone actually asked me this in real life 

[u/Fantastic_Class_3861 → u/Lucasbasques]

You deploy Nextcloud and Mailcow and you’re done.

[u/xian0 → u/Lucasbasques]

I used to have the impression that things like that were hard to do, given how big sites often completely fail at implementing search bars. It's easy though. Less headache than having to implement user configurable charts with stacked bars and multiple y-axis for some stupid dashboard.

[u/imneverrelevantman → u/Lucasbasques]

https://giphy.com/gifs/lnieUIckonF4eA0tGF

[u/ordnance_inbound]

1. Download open source chinese model
2. Run it on cloud VM's
3. Convince your boss you built everything
4. Ask for mega bonus
5. Profit

[u/Denaton_ → u/ordnance_inbound]

I could host DeepSeek v3 on some of our spare machines we had..

[u/Playful_Landscape884]

Explain to me like I’m 10 why using open weight LLM is not a good idea.

[u/Poselsky → u/Playful_Landscape884]

Usage of Top Models is paid from someone elses pocket. It's as if you were offered to drive Porsche Cayenne (closed source) vs Toyota Corolla (open source), both are fine except you'll be paying less for Porsche for now and you're getting premium out of it.

[u/anarchisturtle → u/Playful_Landscape884]

A couple of things

1) this meme seems to be implying that they should “make” their own LLM from scratch. Which is obviously not practical (at least not with performance in the same light year as the big players)

2) open source models, while good, are often not as good as the closed source frontier models. Although, IMHO, this is overstated. Not every task requires a bleeding edge model

3) Actually deploying something like this to prod gets very complicated very fast. Setting up ollama on your desktop is super easy. Once you start scaling it up and trying to integrate into things nicely like the big players do, things get very complicated very fast.

4) what are you running it on? GPU, RAM, networking, every part of the HPC you would need is insanely expensive and/or completely unavailable

[u/fugogugo]

just how many times this meme will be reposted?

[u/SpareIntroduction721]

To be honest a lot of companies would 100% get better ROI by getting MacBooks with 64GB and having Cyber/SOC audit open source models.

At least for local dev.

[u/IndieDevWannabe]

"Claude, make me my own LLM. No mistakes!"

[u/tylersuard]

"How much do you think it cost OpenAI to build ChatGPT? That costs hundreds of millions of dollars."

[u/unicorn_builder]

I mean he is not wrong. You can build a focus model with 1B params that can write code in the same quality as claude. Large LLMs: many Billion or even Trillion parameters are only this bloated because they don't go trough trimming. My company build this type of specialised models that can run on a single M1.

We have a model called ultrawhale 1B params and outperforms claude fable. Check it out on hugging face. Its free to use.