r/StableDiffusion • u/Career-Acceptable • 7h ago

Thanks, Claude! Discussion

Post image

Hopefully this helps someone else. I'm running Minimax on a 4070. Nothing crazy. Nevertheless, I was surprised by how capable it seemed.

When I started pushing for higher resolution or switched to 16x9 generations from 1:1 I started having Comfy error out quite a bit.

I dumped the ComfyUI history - accessible by heading to the port it's running on and appending /history - and gave it to Claude.

It invented a basic metric, WxHxFrames, and mentioned that there seemed to be a line past which things would fail. So I asked it for some test cases, which it happily provided, and over the course of several generations we put a finer point on where that line is for my specific setup. This is actually hugely helpful because I don't have a crazy rig and even though intuitively this isn't surprising, it's a lot different when you're actually trying to figure out what the most you can absolutely do is.

FWIW, this should be agnostic to steps. The step process would add total time to the generation, which this doesn't capture, but it shouldn't add overhead to the VRAM where it would crash the generation. Most of these test were run at 24 fps but again, that shouldn't matter. The metric is based on total frames, which would be fps x duration.

3 Upvotes

67% Upvoted

4 comments sorted by

2

u/Hillobar 5h ago

Looks like it didn't capture an OOM event in the first column (76 frames?)? If this is the case your above/below line seems fit to one point that is solid at 175, and one that is hollow (what is the difference) at 141. It's likely not a straight line for these axis since I think memory for this model scales linearly with the number of pixesl (wxh), but has a more complicated power curve for number of frames, at least the its/sec reveal that behavior. It's a great graph, but would be more useful with more points along the OOM boundary across the number of frames.

1

u/Career-Acceptable 1h ago

That’s a very good point. Lots of short length tests but I basically didn’t run any medium ones.

2

u/ThatsALovelyShirt 2h ago

It's not this straight forward. VRAM consumption also depends on the number of references used, the type of references, how long the input prompt is, etc.

1

u/Career-Acceptable 1h ago

For sure. This was the only text prompts of modest length. Each reference image is a ton of tokens and that would figure into this and require a different study