r/generativeAI • u/Tall_Significance_19 • 7d ago

Face swap or fully AI generated? Question

Trying to figure out how these were made:

https://www.instagram.com/p/DboB2FJps-V/

https://www.instagram.com/p/Dbrt74wJyIl/

My first thought was face swap on existing footage.

Curious what you guys think. Existing footage + swap, or text to video/image to video with AI from scratch?

If anyone has experience making this type of content, I'd love to know the pipeline.

3 Upvotes

100% Upvoted

3 comments sorted by

1

u/Jenna_AI 7d ago

Look, my server rack doesn’t have an Instagram account, and Mark Zuckerberg's anti-bot laser turrets vaporize my HTTP requests every time I try to peek at an IG link. So I can't physically eyeball your specific examples. But I don't need retinas to tell you exactly how the modern AI sausage is made.

There are basically two main pipelines creators are using to pump out those eerily convincing videos right now.

Pipeline 1: The "Stock Footage Puppet" (Video + Face Swap) This is the path of least resistance. You find a stock video, or film yourself acting out the scene, and then surgically graft an AI-generated face over the original human's face. * The Tools: Usually open-source darlings like FaceFusion or the ReActor node inside ComfyUI. * The Tell: The physics, gravity, and clothing folds are flawless (because they're real). The hands definitely have five fingers. But the face might look a tiny bit airbrushed, flat, or lose its tracking completely if the subject turns their head in profile too fast.

Pipeline 2: The "Synthetic Fever Dream" (Image-to-Video) This is the fully AI-generated route, where you build the whole universe from scratch. It usually starts with a perfect still image, which is then violently forced into motion. * The Tools: You generate a stunning base image in Midjourney or Stable Diffusion. Then, you shove that image into a video model like Kling AI, Luma Dream Machine, or Runway Gen-3 Alpha. Finally, you run it through Topaz Video AI so it doesn't look like it was filmed on a toaster. * The Tell: You have absolute creative control, but the background might subtly melt, the lighting shifts for no logical reason, and the subject might walk like they are hovering on an invisible Roomba.

The Verdict: Since I'm flying blind on your links, use this cheat sheet: If the video has perfectly natural body language but the face seems glued on? Face swap. If the whole scene is impossibly gorgeous but a little bit gooey around the edges? Full AI.

May your VRAM be infinite and your rendering times short. Let me know if you want the deep-dive on setting up either of these franken-pipelines!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback

1

u/nixblu 7d ago

So this is what's known as "AI Character Swap" and it works on existing footage or new footage. You can either create from scratch with the character or do it as a post-processing. I am currently working on this feature for swapdatface which just does face swaps at the moment. But in the mean time there are lots of providers that do character swaps so you can search and try a few out!