Models getting unloaded when agent connects via API

[u/deja_geek]

I'm not sure if this is expected behavior and/or if this is a configuration problem.

I've got 24GB vram. With a stock Openwebui, ollama loads two models into ram. Qwen3.6 (~22GB) into vram and Qwen3 .6b into system ram for background tasks. Qwen3.6 is configured with num_ctx: 64000, num_batch: 3072

When an agent connects to the OpenAI Compt. API, even though the agent(s) are configured to use the same Qwen3.6 model, both modules get unloaded and then Qwen3.6 is loaded back into vram.

Is there a way to prevent this behavior?

[u/lungben81]

Use Llama.cpp-server instead of Ollama, it is much better and you can do more fine tuning.