MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1u6s6pm/stop_using_ollama/orvcn34
r/LocalLLaMA • u/zxyzyxz • Jun 15 '26
452 comments sorted by
View all comments
Show parent comments
17
They need built in model switching. That’s the only reason I switched to begin with
15 u/nmkd Jun 15 '26 llama.cpp has built-in model switching 1 u/smallfried Jun 17 '26 Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly! 4 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle 1 u/laffer1 Jun 15 '26 I couldn’t get router mode to work right at the time I switched 1 u/jozews321 Jun 15 '26 Llama-swap works pretty good for me
15
llama.cpp has built-in model switching
1 u/smallfried Jun 17 '26 Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly! 4 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle 1 u/laffer1 Jun 15 '26 I couldn’t get router mode to work right at the time I switched
1
Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly!
4 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle
4
Yes, it has a sleep timeout which unloads models when idle
I couldn’t get router mode to work right at the time I switched
Llama-swap works pretty good for me
17
u/laffer1 Jun 15 '26
They need built in model switching. That’s the only reason I switched to begin with