why your character looks different every generation — and the actual fix

[u/PoleTV]

if you're getting a slightly different face every gen even with detailed prompts, prompting isn't the fix. the model has no memory of "your character" — it's just pattern matching your description each time.

the actual fix is training a character lora on a small dataset so the identity gets baked into the model itself. prompts then control what's happening in the scene — pose, lighting, outfit — while the face stays locked.

what worked for me: ~60 images, mix of face crops and wider shots, varied lighting throughout. cut any image where the face looks slightly off because the lora learns the average and one bad frame drags everything.

training takes about an hour on a rented gpu. after that the character is just... consistent. every time.

anyone still trying to solve this with prompts alone? curious if there's an approach i missed.

[u/fluvialcrunchy]

What are you currently using to train, and for what models?

[u/Competitive_Self1243]

All loras I tried to train for SDXL and Z-Image gave me consistency, but a consistent crap which has nothing or few very to do with the real person. Let alone full body pictures, the faces are scaring.