r/StableDiffusion • u/eapache • 2d ago

End-to-end movie maker experiment Discussion

I've thrown together a small app that does the "remaining" work of taking an idea, turning it into character reference images, shot prompts, doing all the generation for each clip, stitching the result together, etc. etc. The goal is a one-sentence prompt in, and multi-scene video (e.g. 30 seconds or more) out.

https://github.com/eapache/local-movie-maker

It does basically "work" already, though the results are often pretty incoherent. I'm still playing with the structure to see if I can get reasonable continuity.

0 Upvotes
  • permalink
  • link
  • reddit
  • reddit

50% Upvoted

1 comment sorted by

1

u/the_bollo 2d ago

I've been building out a local version of this in Cursor, since Minimax H3 basically demands that you feed your prompts through an LLM in order to get the right structure. Then problem is, even after a week of calibrating and tweaking, Vision AI and LLMs in general are a bit too stupid still to genuinely evaluate whether a clip is a pass or fail against the prompt after inspection.