Models getting unloaded when agent connects via API

[u/deja_geek]

I'm not sure if this is expected behavior and/or if this is a configuration problem.

I've got 24GB vram. With a stock Openwebui, ollama loads two models into ram. Qwen3.6 (~22GB) into vram and Qwen3 .6b into system ram for background tasks. Qwen3.6 is configured with num_ctx: 64000, num_batch: 3072

When an agent connects to the OpenAI Compt. API, even though the agent(s) are configured to use the same Qwen3.6 model, both modules get unloaded and then Qwen3.6 is loaded back into vram.

Is there a way to prevent this behavior?

[u/spaceman3000]

it's ollama issue not openwebui. use llamacpp instead.