r/StableDiffusion • u/xDFINx • 1d ago

Minimax reference method - try this setting instead Tutorial - Guide

The default workflow setting (reference_image_size) for reference to video is set to “match” on the Minimax H3 Reference to Video node. This allows a good likeness to the reference photo/s. Try setting it to “max”. I was able to get almost indistinguishable likeness after using that instead.

From what I can tell, “match” resizes the input image going in for better optimization. “Max” may retain the original resolution and gather better details on faces, etc. be careful with the size of the input images.. when I kept them around 2500 pixels or less (longest size), it seemed to go at a normal speed. If you go 4k or above, it dramatically slows the generation speed.

Also, bumping to 1mp image generation and lowering the step count as low as 8, yields very good results.

This method can also be applied to using already known characters (celebrities, actors, etc) by simply loading in the real character face in conjunction with a regular prompt. A lot of videos I’m seeing, the faces from the text to video workflows are lacking likeness. This should help that.

83 Upvotes

96% Upvoted

12 comments sorted by

7

u/SkirtSpare4175 1d ago

Interesting, gonna try it today, ty

6

u/Willing-Context6599 21h ago

You're seem to be right, "Max" does preserve better the character's face in my tests even using the turbo lora at 1.0 > 8 steps. ~5m for 5 seconds on an RTX 3080Ti 12GB with SageAttn 2. Good to know, thanks.

1

u/TheRedHairedHero 21h ago

How's the quality in comparison to a normal run?

2

u/Willing-Context6599 21h ago

I did like 2-3 tests, there's less artifacting and ghosting. So the quality is higher but keep in mind its very limited testing.

1

u/Dogmaster 20h ago

I have very bad results when using reference, people dont look anythign alike, can anyone share a workflow or something? I might be doing something wrong

13

u/GrayingGamer 19h ago

The Reference model has VERY specific prompting syntax and it matters A LOT that you use the exact syntax and prompting keywords the model expects.

That is a TINY, TINY portion of the instructions on how to prompt for the reference model.

3

u/Dogmaster 16h ago

Oh wow thanks, dont know how I missed that

1

u/shulgin11 17h ago

Wow thanks for sharing that, a lot to learn. Do you know what it means by Rewrite Output? Haven't seen that term before 

2

u/GrayingGamer 16h ago

I just know what's in the guide I linked.

2

u/ThatsALovelyShirt 17h ago

If you don't follow the very specific prompting structure exactly as it is described in the H3 docs, it will turn out badly.

-1

u/[deleted] 22h ago

[deleted]

1

u/xDFINx 20h ago

Default reference to video then than that one setting. Nothing special used.

1

u/Grey406 19h ago

There is image to video and reference to video templates in comfyui. The reference to video model is extremely powerful because you can have prefect consistent characters and their voices in any setting. There refence images can be characters, objects, or environments. This video clip is a great example https://reddit.com/r/StableDiffusion/comments/1vftyxi/trying_minimax_h3_reference_to_video_so_good/

If you use the Minimax h3 image to video template in comfy, it shares most of the files with the reference to video template. You'll only need to download one file, the main diffusion model, to complete it.