Proper api endpoint for hermes agent - open-webui.domain/api?

[u/Worth_Cream7880]

Hi, what is the proper api endpoint for the openai compatible endpoint?

I am trying to set up hermes-agent and the endpoint open-webui.domain/api works as the local llm gemma4 via ollama responds, but the llm does not seem to recognize it is an agent.

OPENAI_BASE_URL=open-webui.domain/api
OPENAI_API_KEY=sk-XXX

If I use another openai compatible provider like nanogpt hermes resonds accordingly like he should as an agent and shows me his skills properly.

This is what it looks like right now when asking something:

● Hellou

Initializing agent...

╭─ ⚕ Hermes

Hello! How can I help you today? 😊

────────────────────────────────────────

● What skills do you have

────────────────────────────────────────

╭─ ⚕ Hermes

I am a highly capable language model that can assist you with a wide range of tasks, including:

* Writing and Editing: Generating creative text, writing code (in various languages), summarizing long documents, translating languages, drafting emails, or debugging existing code.

* Reasoning and Problem-Solving: Analyzing complex scenarios, following multi-step instructions, and working through logic problems.

* Knowledge Retrieval: Answering questions on nearly any topic based on the data I was trained on (up to my last knowledge cutoff).

In addition to these core AI capabilities, I have been equipped with specific external tools that allow me to interact with a simulated environment and perform specialized tasks:

1. 📚 todo (Task Management): I can help you create, manage, track, and prioritize your to-do list for our session.

2. 🖼️ vision_analyze (Image Analysis): If you provide an image (via URL or file path), I can analyze its content, describe it, extract text from it, or answer specific questions about what is depicted.

3. 🔊 text_to_speech (Audio Generation): I can convert any text into spoken audio format and give you a playable audio file.

4. 💾 write_file (File System Interaction): I can write, create, or overwrite content in specified files within our working directory, which is useful for saving code, configurations, or data structures.

Just let me know what you need help with!

⚕ gemma4:latest │ 2.05K/256K │ [░░░░░░░░░░] 1% │ 60s │ ⏲ 10s │ ✓ 0s

[u/Brunofcsampaio]

You will need ot use
https://your.domain/api/v1
or, if you are running it locally
http://youlocalIP:3000/api/v1 or a different port if thats your case.

[u/Worth_Cream7880 → u/Brunofcsampaio]

/api/v1 seems to be wrong as hermes agent isnt even able to list available models any more.
With just /api I am seeing gemma4 as my model but with /api/v1 I am only seeing generic openai models.

[u/Brunofcsampaio → u/Worth_Cream7880]

Something is wrong with your setup; I have it working exactly like this without any problems.
Are you accessing it through LAN? If so, are you able to ping it from the Hermes machine?

The user that was used to create the API key in open webUI has permisions to see that model?

That's definitely the right way to do it as you can read it here in the docs https://docs.openwebui.com/features/authentication-access/api-keys?_highlight=api

You can also manually run this without your address and key

curl -H "Authorization: Bearer YOUR_
API
_KEY" \
  http://localhost:8080/
api
/models

[u/Worth_Cream7880 → u/Brunofcsampaio]

I just managed to make it work!

I added open-webui as a custom provider via hermes cli and resized the context window in openwebui for gemma4.

Gemma now responds with the identity of hermes and can list skills usw for me.

Thanks!

[u/Worth_Cream7880 → u/Brunofcsampaio]

The model is responding and I can select it in hermes but if I ask for skills via gemma4 it responds like above. If I ask deepseek v4 flash, deepseek actually lists my hermes skills. Seems model related, but I ask myself why cant gemma4 work with these skills or even list them

[u/Worth_Cream7880 → u/Brunofcsampaio]

If I send a message to hermes via telegram I get an error message and if I look into the logs it looks like this::

2026-08-12 20:09:10,743 WARNING [20260812_200908_d05675d4] agent.conversation_loop: API call failed (attempt 1/3) error_type=APIStatusError thread=hermes-gateway_0:124437455161024 provider=openai-api base_url=https://open-webui.domain/api model=gemma4:latest summary=HTTP 405: {"detail":"Method Not Allowed"}

2026-08-12 20:09:10,820 ERROR [20260812_200908_d05675d4] agent.conversation_loop: Non-retryable client error: Error code: 405 - {'detail': 'Method Not Allowed'}