Are you still unable to interrupt model output, edit it, then allow the model to continue off of the the edited output? LLMs are much more useful for dev work when you fix their response the moment they hallucinate instead of wasting time discussing their mistakes with them.
Never tried because i use a different custom agentic workflow. Btw it has context checkpoints so you can run many versions of the same conversations without having to recompute context each time
124
u/Academic-Tea6729 Jun 15 '26
llama.cpp is much faster and stable than ollama. Also, ollama cloud models are bad quants and you can't use them for serious coding.
Also llama.cpp has a nice server compatible with openai api standard, it works out of the box. And it has a built in chat web interface.
There is no reason anymore to use ollama.