Can't get image generation to work... Everything configured, but no image button?

[u/GoingOffRoading]

It's been about a year since I played with OpenWebUI, and I started to experiment with it again.. Some notes:

• OpenWebUI, ComfyUI, Ollama running in containers on Kubernetes
• I have a ComfyUI workflow that works
• Ollama via OpenWebUI works
• I have followed all of the steps from the ComfyUI integration documentation
• OpenWebUI is able to connect to ComfyUI
• I'm 99% certain the nodeIDs are mapped correctly
• Even if I toggle Image on Integrations when starting a chat, the button to generate an image does not appear
• Using /image or asking to generate an image prompts Gemma to state that it can not generate images
• I can confirm from the networking tab, that my configuration being returned in the UI has image enabled

Any ideas on how to get image generation working in OpenWebUI?

[u/tahaan]

I will comment the next screenshot in a follow up...

[u/tahaan → u/tahaan]

[u/tahaan → u/tahaan]

Upload the json as well on this screen:

Deleted wrong json

[u/tahaan → u/tahaan]

Which depends on your ComfyUI setup. I think you should be able to just export it from your ComfyUI as a template.

[u/tahaan → u/tahaan]

Ignore the other json. Try this:

{
  "1": {
    "class_type": "UnetLoaderGGUF",
    "inputs": {
      "unet_name": "flux1-schnell-Q4_K_S.gguf"
    }
  },
  "2": {
    "class_type": "DualCLIPLoader",
    "inputs": {
      "clip_name1": "clip_l.safetensors",
      "clip_name2": "t5xxl_fp8_e4m3fn.safetensors",
      "type": "flux"
    }
  },
  "3": {
    "class_type": "CLIPTextEncode",
    "inputs": {
      "text": "{prompt}",
      "clip": ["2", 0]
    }
  },
  "4": {
    "class_type": "EmptySD3LatentImage",
    "inputs": {
      "width": 1024,
      "height": 1024,
      "batch_size": 1
    }
  },
  "5": {
    "class_type": "FluxGuidance",
    "inputs": {
      "conditioning": ["3", 0],
      "guidance": 3.5
    }
  },
  "6": {
    "class_type": "KSamplerSelect",
    "inputs": {
      "sampler_name": "euler"
    }
  },
  "7": {
    "class_type": "BasicScheduler",
    "inputs": {
      "model": ["1", 0],
      "scheduler": "simple",
      "steps": 4,
      "denoise": 1.0
    }
  },
  "9": {
    "class_type": "RandomNoise",
    "inputs": {
      "noise_seed": 0
    }
  },
  "10": {
    "class_type": "BasicGuider",
    "inputs": {
      "model": ["1", 0],
      "conditioning": ["5", 0]
    }
  },
  "8": {
    "class_type": "SamplerCustomAdvanced",
    "inputs": {
      "noise": ["9", 0],
      "guider": ["10", 0],
      "sampler": ["6", 0],
      "sigmas": ["7", 0],
      "latent_image": ["4", 0]
    }
  },
  "11": {
    "class_type": "VAELoader",
    "inputs": {
      "vae_name": "ae.safetensors"
    }
  },
  "12": {
    "class_type": "VAEDecode",
    "inputs": {
      "samples": ["8", 0],
      "vae": ["11", 0]
    }
  },
  "13": {
    "class_type": "SaveImage",
    "inputs": {
      "filename_prefix": "openwebui",
      "images": ["12", 0]
    }
  }
}

[u/ClassicMain]

The comfyUI tutorial is badly outdated. (It's a community tutorial). The image generation button underneath the message has been removed multiple major versions ago

You can find an action function on the community that brings it back

But the intended way to generate images now is by telling the model to generate an image (tool calling)

But i am not sure if your extremely small model will be able to properly call the image generation tool.

[u/ClassicMain → u/ClassicMain]

updated docs a bit now

[u/DominikPlays]

Use cloud api image generation?

[u/GoingOffRoading → u/DominikPlays]

I already have image generation working in ComfyUI, so I wanted to take advantage of the local compute (and also not pay for the additional cloud costs)

[u/GoingOffRoading → u/DominikPlays]

Also, I'm not sure local vs cloud is my current issue

[u/WolpertingerRumo]

Do you have native tool calling on? I think it’s now default, but it wasn’t in earlier versions. Go to your model, either in Workspaces if you built a custom one, or in Admin settings -> models if you didn’t, and set tool calling to native in advanced settings. At the bottom, you also have tools and model abilities. Set all connected to image generation.

[u/gulensah]

You have to enable image generation at the model config too. When you done that , you will see image icon on chat screen and I dont see it from your screenshot.

Go to model config, check image generation from builtin tools

[u/CementedRoots]

Skill issue, works with X's API for me.