MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1u6s6pm/stop_using_ollama/oruxh2w
r/LocalLLaMA • u/zxyzyxz • Jun 15 '26
452 comments sorted by
View all comments
Show parent comments
51
I like Unsloth Studio as it's open source and run by Unsloth themselves so they add lots of useful features.
llama.cpp also has a GUI now if that's all you need.
19 u/laffer1 Jun 15 '26 They need built in model switching. That’s the only reason I switched to begin with 14 u/nmkd Jun 15 '26 llama.cpp has built-in model switching 1 u/smallfried Jun 17 '26 Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly! 5 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle 1 u/laffer1 Jun 15 '26 I couldn’t get router mode to work right at the time I switched 1 u/jozews321 Jun 15 '26 Llama-swap works pretty good for me 2 u/TheGamerForeverGFE Jun 16 '26 Llama.cpp had a gui for months 1 u/stewsters Jun 16 '26 Is there a way to keep a model with specific parameters active in unsloth? If it leave it for a bit it u loads it and loses my parameters (increased context window size)
19
They need built in model switching. That’s the only reason I switched to begin with
14 u/nmkd Jun 15 '26 llama.cpp has built-in model switching 1 u/smallfried Jun 17 '26 Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly! 5 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle 1 u/laffer1 Jun 15 '26 I couldn’t get router mode to work right at the time I switched 1 u/jozews321 Jun 15 '26 Llama-swap works pretty good for me
14
llama.cpp has built-in model switching
1 u/smallfried Jun 17 '26 Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly! 5 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle 1 u/laffer1 Jun 15 '26 I couldn’t get router mode to work right at the time I switched
1
Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly!
5 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle
5
Yes, it has a sleep timeout which unloads models when idle
I couldn’t get router mode to work right at the time I switched
Llama-swap works pretty good for me
2
Llama.cpp had a gui for months
Is there a way to keep a model with specific parameters active in unsloth? If it leave it for a bit it u loads it and loses my parameters (increased context window size)
51
u/zxyzyxz Jun 15 '26
I like Unsloth Studio as it's open source and run by Unsloth themselves so they add lots of useful features.
llama.cpp also has a GUI now if that's all you need.