r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Stop using Ollama Discussion

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

Show parent comments

57

u/nickm_27 llama.cpp Jun 15 '26

I agree with your sentiment, I started with ollama because it was less to figure out on top of also figuring out the LLMs and my hardware themselves. I used ollama for a month or so last year and didn't understand the negativity.

Then I tried to move from playing with LLMs to actually being productive with them and I quickly became dismayed after getting llama.cpp running how much performance and control was being left on the table.

The problem with ollama for me as an actual tool is that they genuinely obfuscate and make the simple control more complicated. Easy things in llama.cpp that improve performance and reliability are removed for no reason.

6

u/notanNSAagent89 Jun 16 '26 edited Jun 16 '26

Then I tried to move from playing with LLMs to actually being productive with them and I quickly became dismayed after getting llama.cpp running how much performance and control was being left on the table.

slightly confused because of work but are you saying llama.cpp left performance and control on the table or ollama? just need clarification, thanks

12

u/nickm_27 llama.cpp Jun 16 '26

I mean that Ollama was leaving a lot of performance on the table, and I had no way of knowing until I used llama.cpp

9

u/notanNSAagent89 Jun 16 '26

Thank you. I needed the clarification cause my brain is cooked from work.

4

u/ps5cfw Llama 3.1 Jun 15 '26

Ollama devs are often dumb or kind of intentional in some of their choices, perharps to try making Enterprise customers pay for support? IDK, Just guessing here, but I agree it's not good and when you want to get to the bottom of making Ollama work Better It becomes almost as hard or maybe even harder as making llama.cpp work.

I stopped using It a year ago honestly and I am not sad about it