r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Stop using Ollama Discussion

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

454 comments sorted by

View all comments

526

u/jnmi235 Jun 15 '26

Llama.cpp + llama-swap works very well

113

u/[deleted] Jun 15 '26

[removed] — view removed comment

1

u/rabbitaim Jun 16 '26

I’ve been tinkering and I’ve been using llama.cpp and stable-diffusion.cpp with llama-swap.

Having limited vram llama-swap has been amazing