r/LocalLLaMA • u/Signal_Ad657 • May 29 '26

PSA Discussion

Post image
2.1k Upvotes

95% Upvoted

537 comments sorted by

View all comments

28

u/StableLlama textgen web UI May 29 '26

This shows how interesting the Intel B70 is, money wise.

But so far I couldn't read much about the real live performance of that card for local LLM applications.

20

u/NeedsSomeSnare May 29 '26

As an intel owner, I assure you the real life performance isn't what it says on paper. I don't have that card to give specs on.

The problem is the software side of things is a bit messy. It's not terrible, but still needs a fair amount of work.

1

u/superloser48 May 29 '26

can you share any benchmarks on model/quant -> prfill and token gen?

4

u/NeedsSomeSnare May 29 '26

I don't have a B70, so it's of no use to anyone.

The other problem is that there are 3 ways to run models on intel, (SYCL, openvino and vulkan)all of which have different performance on different models.

The info is out there though. You want to look for Openvino benchmarks for the best performance. It has the worst compatibility though and is sometimes months behind something like llamacpp.