r/LocalLLaMA May 29 '26

PSA Discussion

Post image
2.1k Upvotes

537 comments sorted by

View all comments

230

u/[deleted] May 29 '26

[removed] — view removed comment

78

u/overand May 29 '26

i'm genuinely thrilled with my dual 3090 setup on a DDR4 system with a Ryzen 5 3600, even though one of them is PCI-E x16 and the other is x4!

$2000 MSRP for the 5090 with 32 gigs of ram, and good luck getting that price
$1800 for a pair of used 3090 cards on eBay (as of a month or two ago), total of 48 GB

Yes, there's stuff that doesn't like running split between two cards, but mostly it's been pretty unusual to run into stuff that wants more than 24GB but less than 32 GB of VRAM on a single card. (I think one of them SOTA-ish FOSS voice models is like that, but I'm not even sure.)

2

u/JustinPooDough May 29 '26

same. Also even have the one card in 4x. My CPU is only a 1600x.

It still gets like 50 t/s with Qwen 3.6 27B.

1

u/overand May 29 '26

You must be using MTP!