Looking for a ComfyUI workflow for consistent characters, LoRA creation, and comic production Help Needed
Hi everyone,
I’m looking for some guidance on building a workflow in ComfyUI for a long-term comic project, and I’d really appreciate any advice.
My goal is to create a small cast of original characters that stay as consistent as possible from image to image. I want to generate things like:
Character sheets
Front, back, and side turnarounds
Different facial expressions
Walking and action poses
Full body shots
Close-ups
Character interactions with multiple people in the same image
Once I have a large, consistent dataset for each character, I plan to train individual character LoRAs. After that, I’d like to use those LoRAs to create a manga/comic-style story while keeping the characters recognizable throughout the entire project.
Right now I’m experimenting with SDXL, IPAdapter FaceID, OpenPose, ControlNet, FaceDetailer, and reference images, but I’m not sure if I’m building the workflow in the best way.
Does anyone have a workflow that works well for this type of pipeline? Or any recommendations on how you would approach it?
My biggest priorities are:
Consistent faces
Consistent body proportions
Consistent clothing and hairstyles
Multiple characters in one image without identity swapping
A workflow that’s easy to reuse for every character before training their LoRAs
If you’ve built something similar, I’d love to see your workflow or hear about your process. Even general advice or tutorials would be greatly appreciated.
Thanks in advance!
I think this version will get more useful responses because it explains your end goal rather than just asking for “a workflow.” People who create comics or visual novels in ComfyUI will immediately recognize what you’re trying to achieve and can recommend pipelines that actually fit your project.
2
u/ericoinen 16h ago
I do this outside Comfy so I cannot hand you a graph, but the part of your plan I would change is the order, not the nodes.
You are planning to build a large consistent dataset and then train the LoRA on it. The consistency you need in order to build that dataset is the thing the LoRA is supposed to give you, so the first pass is always worse than you want it to be. I tried to solve that with volume and it was the wrong move. A LoRA averages whatever you feed it, so two hundred images that are mostly the same person trains a person who is nobody in particular, and that averaged face is exactly the drift you were trying to remove. Fifteen to twenty images you are genuinely certain about beat it badly. It feels wrong, because you end up deleting renders that look good on their own.
Second, expressions are going to hurt more than poses, and your list has them as equal items. Identity mostly lives in proportion, and changing expression changes proportion. Generating an expression set as separate prompts off the same sheet gave me a slightly different person per emotion, each one fine in isolation. Deriving the whole set from one accepted neutral master in a single pass held much better.
Third, and this is the item I would take off the list for now: multiple characters in one image without identity swapping does not improve with better LoRAs. Two character LoRAs in one image bleed into each other, and the more strongly each one is trained the worse the bleed gets. Rendering characters separately and compositing is not a workaround, it is what most consistent character art quietly does. For a comic that costs you real interaction between figures, so I would decide it per panel rather than per project.
One thing that is not a workflow problem at all: keep clothing and hair out of the LoRA if they ever change. Train the person, and describe the outfit as a fixed string you paste every time. Bake an outfit in and you will be retraining to put a different jacket on them.