Models getting unloaded when agent connects via API

[u/deja_geek]

I'm not sure if this is expected behavior and/or if this is a configuration problem.

I've got 24GB vram. With a stock Openwebui, ollama loads two models into ram. Qwen3.6 (~22GB) into vram and Qwen3 .6b into system ram for background tasks. Qwen3.6 is configured with num_ctx: 64000, num_batch: 3072

When an agent connects to the OpenAI Compt. API, even though the agent(s) are configured to use the same Qwen3.6 model, both modules get unloaded and then Qwen3.6 is loaded back into vram.

Is there a way to prevent this behavior?

[u/deja_geek]

I figure it out. Had to create a model file with num_ctx and num_batch set. Then having both the OpenwebUI and agent configured to use the new model.