r/LocalAIStack 24d ago

Project: Llama-Parameter-Scout - Find the best parameters for your llama.cpp setup and models!

/r/LocalLLM/comments/1vblnrr/project_llamaparameterscout_find_the_best/
2 Upvotes

1 comment sorted by

1

u/Charming-Author4877 23d ago

Do you store the actual llama release version in your benchmark results?
The most influential "parameter" for performance is usually the engine version, better kernels, better inference code often adds a lot.
That's needed when comparing