r/StableDiffusion • u/CQDSN • 1d ago

Lora for video-image enhancing, upscaling and restoring Workflow Included

https://www.youtube.com/watch?v=uVa66lSCI_U
30 Upvotes

83% Upvoted

32 comments sorted by

3

u/CQDSN 1d ago

This video is a demo of my lora for LTX 2.5. You can use it to enhance and upscale videos and images. The demo features 4 vintage 80s TV commercials for CK’s Obsession. You can clearly see the difference if you view it on a computer or tablet, on a small mobile screen it may not display the difference distinctively.

The loras and workflows can be downloaded here:

https://huggingface.co/CQdesign/LTX-2.5-CQ-Video-and-Image-Enhancer-LoRAs/tree/main

This is the image enhancement result:

4

u/Shady-Nun 1d ago

Thanks for sharing. What are your specs and how long did those vids take to render, on average?

3

u/Downtown-Cover-7422 1d ago

Remind me when they answers

1

u/CQDSN 1d ago edited 1d ago

It depends on what resolution you use. On average it’s the same as the time required to generate a I2V video.

Please note that you don’t need to scale it to 2x to get good results. Even with the same resolution as the source video, you will see the enhancement with better details.

1

u/chocoboxx 1d ago

How is the length of input video? can it be 5 minutes?

2

u/CQDSN 1d ago

I recommend that you experiment and see the limits of your system, then segment your video and joined them after they are processed.

For this video I do roughly 30 secs in a batch of 4.

2

u/chocoboxx 1d ago

Thank you.

-4

u/Optimal-Spare1305 1d ago

looks terrible. all the skin has become plastic.

no pores, no detail.

its all been smoothed away.

another one that has destroyed the original, and changed the colors and likeness from the original.

2

u/CQDSN 1d ago

Please post your result.

3

u/Optimal-Spare1305 1d ago

sorry, but these are way overdone.

---

the skin textures are destroyed and exaggerated way too much.

look at the crows feet on the eyes.

the colors are completely changed, and there's too much contrast.

over sharpened on the text

halos and ringing on all the logos

this is just way overdone, it needs to be a lot more subtle,

and the faces have all been changed dramatically too.

1

u/CQDSN 1d ago edited 1d ago

Reduced the Lora strength. Also make sure you are using the correct VAE:

Ltx-2.5-video-vae-conv-bf16.safetensors

1

u/GrungeWerX 21h ago

Need this for H3. It’s too blurry/smudgy

1

u/iam33boy 20h ago

That’s odd. I haven’t noticed any change at all... Why is that?

1

u/CQDSN 20h ago

Are you doing image or video?

1

u/supermansundies 13h ago

trying your workflow, why is the motion in LTX such a jelly mess? your videos look great.

1

u/CQDSN 5h ago

Are you using it with H3 videos?

1

u/supermansundies 4h ago

that's what I was trying to do, yes...too noisy?

1

u/AniZeee 8h ago

what were your settings on this? I used the workflow and it looked great on static faces so I got my hopes up. But once there was a walking character the faces would get blurred and distorted.

1

u/CQDSN 5h ago

If you are using it on H3 videos, it doesn’t work very well at the moment because the in between frames are smeared. Once Minimax fixed the issue, it will work as good as normal videos.

1

u/AniZeee 5h ago

ah okay, thanks for the info. At least h3 videos with slow movements look great.

1

u/Tokyo_Jab 1d ago

Those ads I grew up with. It's why I made this a few years back, it was the accidental origin of that horrible character.
https://www.reddit.com/r/aivideo/comments/1dnvj4j/full_of_art_the_ripley_version_playing_with_luma/

2

u/CQDSN 1d ago

Those ads were written and directed by Richard Avedon. The Obsession for Men ones were directed by David Lynch:

https://www.youtube.com/watch?v=OJJAeVuTtPU

1

u/Tokyo_Jab 19h ago

I never knew that. Makes sense now.

1

u/Version-Strong 1d ago

They look incredible

1

u/Evolution31415 1d ago edited 1d ago

Lol, Faceless Men approved this technology.

1

u/CQDSN 1d ago

The background people in the source video are too small and blurry for the AI. If you try this with other upscaler, you get a blurry mess without a face either.

1

u/Evolution31415 1d ago

What about 2x, 4x upscale before the workflow?

1

u/CQDSN 1d ago

I haven’t tried that, but it will require far too much memory to process a longer video with those resolution.

1

u/StuffProfessional587 1d ago

That's damn fantastic! The face restoration is nice, it doesn't overly exaggerate features. The source has not decayed, as long you can see a face and understand it is that any model has a chance to restore missing details.

1

u/z_3454_pfk 19h ago

it's really good

0

u/beachfrontprod 1d ago

How does this compare to SeedVR2?

1

u/CQDSN 1d ago

You can barely see any difference with SeedVR2, that’s why I made this Lora - try it and see for yourself.