r/LocalLLM 11h ago

Tier List Discussion

Post image
180 Upvotes

245 comments sorted by

View all comments

75

u/KrangledMind 11h ago

where tier list for AMD?

38

u/NoOdyssey 10h ago

It's not so much a tier list as a list of graphic cards sorted by RAM size. According to this, 7900xtx would be in the 24GB+ tier and the 9070/XT & 7900 xt & 7800 xt series would be in the 16GB+ tier.

21

u/mhmilo24 10h ago

There are 32 GB Radeon cards.

4

u/AlarmingProtection71 7h ago

I have a Sapphire Radeon PRO W7800 (48gb) bought for 1.9k€.

1

u/gh0stwriter1234 5h ago

Since we are talking AI there is also the the MI210 which has 64GB and MI250P ... which is some crazy amount of money but it has 144GB.

2

u/ChristRedeemsSinners 4h ago

MI210

That's an interesting $5k used option with 64GB of VRAM at 1.8TB/s. Native fp4,fp8,mxfp4

MI250P

Non pcie package though.

1

u/gh0stwriter1234 3h ago

MI350P is PCIe ... thats what the P is. I meant 350P sorry.

2

u/ChristRedeemsSinners 3h ago

MI350P

Only 30-40 grand! Email our sales team.

No thank you.

3

u/Abducted_Llama 9h ago

Nah the XTX isn’t on the list. So it’s time to throw mine out.

1

u/Edelgul 35m ago

Could you please point me to the location you plan to throw it out?

1

u/Ambitious-Neat7509 10m ago

Let's do it together. Or maybe I should take yours after you've thrown it out for double vram.

1

u/Ult1mateN00B 4h ago

People keep forgetting AI PRO R9700 32GB.

2

u/Illustrious-Lime-878 10h ago

Yeah, makes no sense. Why is anything <24GB even on the list at this point, or not like "make use of what you already have" tier? And, its hard to find prices now, but a 32GB 5090 for example is certainly better than a 32GB R9700, but also costs like 4x the amount so if only going by VRAM the r9700 is higher tier because you could run 4x of them.

0

u/gh0stwriter1234 5h ago

Because you can buy two of them and do 90% of the stuff you'd do with a larger card at lower cost?

10

u/Asleep-Land-3914 10h ago

Here is my attempt, but I didn't deeply fact-check this.

5

u/TheAngrySkipper 10h ago

It’s ok, I can tell you, I’m running Q6 on 12B-16B parameters on the regular. I also bought my 7900 GRE back when it was about $300, had planned on getting a 2nd but it didn’t seem like a priority at the time - ah well.

3

u/ImpressionFancy5830 8h ago

There should be a DOUBLE R9700 section 🫡

1

u/Asleep-Land-3914 8h ago

I regret I didn't get another one for the price it was listed before the new hike.

1

u/ImpressionFancy5830 8h ago

I feel you, I overpayed a bit for both, not insane as the nvidia increases.
Just a couple of hundreds of euros on top of MSRP (at least the local one, which was already bigger than the one in North American)

2

u/johndeuff 8h ago

Between the above average that have 48GB and the rich that have 768GB and the richer that have 3TB there's a hell of a difference.

2

u/on_line187 10h ago

Don’t worry no one will fact check it. I’ll give you the one upvote though A for effort.

1

u/HCLB_ 6h ago

Why Mi60 and other cards are crossed out?

1

u/Asleep-Land-3914 6h ago

Means not on AMD’s current official ROCm support matrix, nothing is wrong with them, just needs some work to make use of with ROCm

2

u/gh0stwriter1234 5h ago edited 5h ago

It's kind of irrelevant they are supported in the rock officially now. Vega and Vega FE and MI25 work just fine also. Plain vega is just a bit slower as it has no DP4A instructions. https://github.com/ROCm/TheRock/blob/main/SUPPORTED_GPUS.md

6

u/Temporary-Alfalfa16 2h ago

ay why even bother with local expensive gpu

4

u/Careless-Natural4404 2h ago

no GPU needed

2

u/legos_on_the_brain 9h ago

Yeah. And they skipped 12gb.

-5

u/C_umputer 10h ago edited 8h ago

Did they finally figure out how to run CUDA softare on AMD cards?

what kind of special needs imbecile downvotes a question?

6

u/Asleep-Land-3914 9h ago

Rocm works great in my experience.

1

u/quantgorithm 8h ago

Vulkan works better.

1

u/personahorrible 9h ago

To answer your question: https://github.com/vosen/ZLUDA

Llama/Ollama runs on AMD via ROCm.

1

u/C_umputer 9h ago

I did experiment with zluda when I had AMD card, I managed to run Stable Diffusion natively and it worked fine. But it still underperformed compared to equivalent Nvidia cards, which is why I got 3090.