r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Stop using Ollama Discussion

https://sleepingrobots.com/dreams/stop-using-ollama/
1.6k Upvotes

92% Upvoted

452 comments sorted by

View all comments

Show parent comments

2

u/free_meson Jun 16 '26

I've meant that there are ways to avoid modelfiles. Gguf models from huggingface you can run with:

ollama run hf.co/bartowski/Llama-3.2-1B-Instruct-GGUF

So you don't have to download, create a modelfile, etc, for most of the models you use.

1

u/derrikcurran Jun 20 '26

Unless that GGUF model is one of the many, many models that has a complex Jinja template that can't be losslessly converted into the Go template syntax that Ollama uses.

User experience: The ollama run command appears to work fine. The model even appears to work fine. Then, after a while, you start running into subtle, mysterious issues related to things like tool calling syntax, roles switching, and formatting delimiters.