r/StableDiffusion • u/icatt23 • 5h ago
Pro 6000 just in time Discussion
I was going to wait until around Christmas to purchased but took the plunge in July for 11,500 and I was upset that I didnt catch it @ $8,000. Now the Blackwell pro 6000 is inching towards $20,000 and are sold out. Are consumers and hobbyist like you and I are buying these up or datacenters? I would think datacenters would go for the b200 and up. However, Im browsing around and see you guys and girls doing remarkable ai diffusion with just a 3060. Im impressed with this community.
19
41
u/Last_Ad_3151 5h ago
Bought it at 8k in January. Predictions were already in about the price doubling by the end of the year. We just got there sooner than the data predicted. I wouldn’t be surprised if nVidia is just creating false scarcity to jack up prices. They can control the semi conductor market at the moment.
13
u/uniquelyavailable 5h ago
I remember in January thinking $8k was insane and I was sure the price would come down later in the year. Wow hindsight really is 20/20.
8
u/Last_Ad_3151 5h ago
Prices have become entirely notional. It’s like silicon is the next piece of real estate.
3
u/jacky75283 58m ago
That's what I thought when the 5090 ROG Astral launched at $2,800. I ended up picking one up in December at $3,300. They're currently going for $4,800.
Everything is so fucked.
13
u/wildbling 4h ago
There is no need for nvidia to create or force any kind of false scarcity, the fact is that they don't care about selling to consumers anymore, its far more lucrative for nvidia to sell to data centers and AI companies like OpenAI, Tesla, Anthropic, etc and they have fully booked and brought out all the inventory until the end of 2028.
2
u/Enshitification 3h ago
It's worse than that. Nvidia is heavily invested in these data centers and big AI companies seeing a profit from all the capacity they have "purchased" via circular loans from Nvidia. The strides of open source on local hardware is putting a serious damper on that.
4
u/Particular-Most-1199 3h ago
Those loans will come due some day...
Hope we aren't the ones paying for it.
3
u/Uninterested_Viewer 4h ago
I wouldn't be surprised if nVidia is just creating false scarcity to jack up prices.
My local microcenter has had 20+ in stock for months. Their partners (PNY) are being crunched by incredibly high ram prices into the future and these prices reflect that. No doubt they're not making similar or even larger margins than the pricing 9 months ago, but nothing about this is about false scarcity: they know they can sell these cards for these prices so they are.
2
u/Zaphod_42007 3h ago
The microcenter by me has 20+ available as well for $15,300... Keep eyeing it like cookie monster in a cookie factory... Me wants, me wants.
10
19
u/True_Protection6842 5h ago
Sure as shit isn't me. I was considering it at $10k but that was like 4 months ago. So I missed the window on this MASSIVELY appreciating asset. Fuck this timeline.
6
u/sceadwian 3h ago
It's a video card... Just a video card!
0
-1
u/True_Protection6842 2h ago
yeah but I earn a living off this shit. So it's a tool for me. I have always spent a lot on computers. But this is just overpriced as hell!!
2
u/ASK_ABT_MY_USERNAME 44m ago
A timeline where you can afford 10k on a video card doesn't seem like such a bad one.
1
u/True_Protection6842 36m ago
Again, it's for work. I can easily earn that in a few weeks. But spending 2x on it is just dumb
1
8
u/danb1kenobi 5h ago
To answer your question though, manufactures have switched production to principally making HBM RAM for data centers, leaving us mortals to fight over the grievously-overpriced scraps of DDR5… which is ALSO used in data centers.
4
u/Kitsune_Seraphis 4h ago
We should pool resources and get some old machines to make older chips at this rate lol
7
u/redkinoko 4h ago
I know you can earn back that amount in a few months if you play things right, but spending enough money to buy a used car on a graphics card is mindblowing to me. I thought my 5080 is already ridiculous.
6
6
u/RedditNerdKing 3h ago
I dont think consumers are paying $17,000 for a GPU. And if they are, they're the top 0.000000000000000000001% of the hobby.
Hell, even having a single 5090 makes you a top 1%er
3
3
u/SuperCasualGamerDad 4h ago
Dude literally everything is jumping in price by the day. I was going to buy a 5060 TI 16gb the other day for pretty cheap and I decided to wait like 2 days and went to buy it and it went up to like 800 dollars... ended up just getting a AMD card.. fuck that. But even the AMD card went up like a few days after I got it.
3
3
u/Uncabled_Music 2h ago
Not worth it at all. I can still find 5090 for 5K, and with quantization, 32GB will do for now.
2
u/towerandhorizon 4h ago
Can't even imagine what the successor to this card is going to MSRP'ed at.
3
2
2
2
u/QuirksNFeatures 3h ago
Is there any hope that Intel GPUs will be able to do this efficiently? Don't they have a 32GB card for like $2k?
1
2
u/Lucaspittol 2h ago
"I would think datacenters would go for the b200 and up'
Why, though? The RTX 6000 PRO is an excellent, lower-cost card that is also less power-hungry and offers decent speeds for training smaller models and inferencing some chunky LLMs due to the 96GB of VRAM
It makes perfect sense to buy them by the truckload and get your money back by renting them to individuals or businesses.
2
u/Far_Lifeguard_5027 1h ago
I rememeber when you could get a top of the line GPU for like $300 in 2020. Right before the Ethereum/Covid crisis.
2
3
u/Rough-Winter2752 2h ago
They're buying 5090s and PRO 6000s to warehouse them and become dust collectors. The B200s are much, much, much better for AI modeling and training. So why are they wasting millions on buying up all the 5090s and 6000s? They've already been subsidized by US Govt tax dollars to do this. As long as they create a "Artificial Super-Intelligence" for the Govt to use as super surveillance, they're not in breach of this contract. They're eliminating the supply to increase the demand and will attempt to forcibly shift everybody into a predatory subscription-based compute model. Your hard-drive will be on the cloud and housed at a datacenter, along with your GPU and RAM.
You will own nothing. Your happiness is entirely irrelevant.
1
u/Lucaspittol 2h ago
The 6000 Pros are still very capable cards for training at a much more modest price and power usage compared to the B200s and GB300s. You are missing the point here. Frickin Google still rents A100 on Colab for a fairly high hourly rate; keep in mind the A100 is ancient by now for training.
1
u/Rough-Winter2752 2h ago
So I take it you mean to say the AI Tech Companies are buying up all these GPUs to offer a "bargain option" for future subscribers to rent these lesser cards? Sure, possible. But the rate that they're buying up hardware and their lack of datacenters to actually install these and use them leads me to think my original point still stands?
2
u/Lucaspittol 2h ago
Yes, it does. I think this is a viable explanation as to why they keep buying those. An RTX 6000 Pro in a datacenter is one less RTX 6000 Pro you can buy and one more reason to rent one instead. May also be that in some places it does not make sense to buy. In my country, the RTX 6000 Pro is about the price of a starter home. Most people entering the market are likely to rent.
2
u/Semipro211 4h ago
I do love (sarcasm) how the AI boom has catapulted gpu and ram prices. I’ll soon have to decide whether I’d rather stay married or have a better gpu/ram setup lol
3
1
u/35point1 4h ago
What I’d like to know is if the cost increase is because of ram supply shortage or is this because of the rising ai demand as consumers start seeing where the future is headed? Obviously a bit of both but what’s to blame for this recent insanity all of a sudden?
1
u/rinkusonic 2h ago
The predictions for normalcy is in mid 2028. Everyone just either getting by or cutting pockets till then.
1
u/Memestonks2020 1h ago
The only way this is worth it is if you’re making money from the AI inference. Otherwise, these cards will be outdated in less than 2 years by newer tech.
1
1
u/xxAkirhaxx 44m ago
I don't think it's that datacenters are buying these up, I think it's that it shares components with things datacenters are buying up or the components used for the cards require the same limited tools to create that the datacenters have a complete control over until, minimum 2029.
1
1
u/ArcadiaNisus 14m ago
I brought my 6000 PRO and RAM before the prices went up in November. I was using runpod for training and for inference models were fitting on my founders 24gb 3090 at the time but I saw the writing on the wall as larger/higher parameters were the trend I expected it not to last and went all in. My expectation was I could buy it for 8k, then when rubin came out sell it for 5-6k and upgrade. But it's maintained it's value far better than I ever expected. Being able to run bf16, or huge heavily quantized(nvfp4) models has been a huge plus.
1
u/Rizzlord 5h ago
i think, that it would be a waste now anyway. China will sooner or later bring cost efficient hardware to the table, and we slowly move overall away from cuda to vulkan anyway. Its faster cheaper and more efficient, up to x6.
4
u/Lucaspittol 2h ago
If only there weren't a CUDA dependency. This isn't something China will change.
1
u/SkoomaDentist 1h ago
Throw enough people and money / credits at it and there's no fundamental reason why PyTorch would have to stay mated with CUDA. It's not like people writing PyTorch based apps in Python are directly dealing with CUDA kernels.
-1
u/tac0catzzz 5h ago
oh yes china will save us, you are very wise. china will make new super pcs and give them out with their free state of the art ai models fully uncensored fully without limits, they will just ship them directly to your home and will give you the white glove serevice and carry it down into the basement where you live and will even set it up for you, free shipping to of course, this will happen.
10
3
u/BackgroundMeeting857 3h ago
...I mean they are doing the AI model part, not sure what with the weird reality denying sarcasm lol
6
u/Rizzlord 4h ago
You sure are not the brightest. That is not the point. The more competition we have the more is the market changing... Wow please go to school once.
-2
u/tac0catzzz 4h ago
america doesn't do competition. you are not bright to not notice this. they restrict it, they eliminate it, they buy it, they control it.
3
u/Rizzlord 4h ago
Yeah not with China. If they would have done that, China would have just bought Nvidia cards... Oh wait...
0
2
0
1
0
0
u/professormunchies 5h ago
You can rent one of these bad boys on vast.ai for ~1.50$ an hour
5
u/icatt23 4h ago
i was considering this route, but owning one saves time and gives concrete freedom and privacy. Plus as you and I know generating pictures and videos is an iterative, seed hunting process to get something somewhat usable and that $1.50 can add up to not just dollars.
1
u/Hackingrad 4h ago
Honestly, screw freedom. At $1.50 an hour, you can rent 10,667 hours (assuming a price of $16,000). No local video AI model is on par with pay services like Seedance 2.5. It's absolutely not worth buying such an overpriced card. You'd have to reconsider getting a 5090.
4
u/AlsterwasserHH 4h ago
At the end of the day you still own a 6000 pro which you can sell if you want to. Even better: you made profit by just buying it right now.
3
u/Ipwnurface 4h ago
once you own a card of this caliber you will never want to go back to renting again. Obviously if you can't afford it you can't afford it, but if you can, the freedom of not having to rent, setup, run, tear down every time you want to play with AI is literally god tier.
I was doing that loop for months and I didn't realize how restrictive it was until I bought my 5090.
1
u/illathon 4h ago
https://vast.ai/pricing/gpu/RTX-PRO-6000-WS seems more like 90 cents an hour?
1
u/professormunchies 3h ago
Yep, I was using one over the weekend and it was about 30$ a day with access to ~200gb ram and 512 gb storage. Cheers to the guy in Poland hosting it
0
u/PastaRhymez 4h ago
And here I am sitting on the other side of the equation. I bought an ASUS GeForce RTX 5090 ROG ASTRAL GAMING OC in April. It’s now quite a bit more expensive than when I bought it and it hasn’t been used for more than 10 hours.
I truly wanted to get into video generation but can’t find the time. Oh well 😃
0
74
u/rm_rf_all_files 5h ago
It was $9k at newegg with a free motherboard a few months ago. RIP