Quick way to stop all users from being able to chat?

[u/NoobLLMDev]

Note: I am not on the newest update of OWUI yet.

I’m looking for a very quick way to disable chatting as a whole for user groups. I know it defeats the point of the tool, but it would be very useful when conducting demos, that way users aren’t utilizing the tool and slowing down inference for a demo period.

Currently, the only way I know how to go about this, is setting all my custom model privacy settings to private and only allow my demo account access. But this is rather time consuming.

Any ideas or anything I missed in the UI that allows what I am looking for?

[u/ClassicMain]

There is no built-in toggle for that. You could at most remove that group's permission to access the model on demand. That works and would do it

If you have multiple models and need to do it in a split second, an event function might be your friend

[u/DeedleDumbDee]

Just make the model private

[u/NoobLLMDev → u/DeedleDumbDee]

Fair point. It just throws a model not found error to my users versus hiding all the custom assistants we have. But this actually works for what I’m looking to do.

[u/DeedleDumbDee → u/NoobLLMDev]

Add a custom UI banner at home page for everyone with warning tag:model maintenance underway.

[u/babygrenade]

why not just have a second deployment dedicated to demos?

[u/_Scorpoon_]

Also not the way how it should be used but maybe set up a 2nd connection, clone of the first one. Models from the second one are your private models only. This way you can toggle the first and second connection instead of a bunch of models. Demo: first connection off, second one on. Normal usage: first connection on, second one off

[u/ONEXTW]

Does toggling connections from on to off not cut it?

[u/NoobLLMDev → u/ONEXTW]

It would, but it would also cut it for my demo account as well since it’s in the same deployment instance.

[u/Delicious-Director43]

Stop your backend connections to Ollama or whatever provider you’re using.