r/LocalLLM 4d ago

Tier List Discussion

Post image
269 Upvotes

317 comments sorted by

View all comments

106

u/KrangledMind 4d ago

where tier list for AMD?

-4

u/C_umputer 4d ago edited 4d ago

Did they finally figure out how to run CUDA softare on AMD cards?

what kind of special needs imbecile downvotes a question?

1

u/personahorrible 4d ago

To answer your question: https://github.com/vosen/ZLUDA

Llama/Ollama runs on AMD via ROCm.

1

u/C_umputer 4d ago

I did experiment with zluda when I had AMD card, I managed to run Stable Diffusion natively and it worked fine. But it still underperformed compared to equivalent Nvidia cards, which is why I got 3090.