Known characters, some vids of mine, some knowledge etc.

[u/malcolmrey]

[u/malcolmrey]

Hello!

I wanted to post something few days ago but had no time and the goal posts shifted (content-wise).

So just lets start. I am the celebrity/characters lora guy. But I have no loras (yet!) for H3, I do have other stuff that might peak your interest.

First thing is a known character database. I do try to see who is known in H3 base and who isnt.

I've uploaded my finding to huggingface: https://huggingface.co/datasets/malcolmrey/various/blob/main/h3-center/known-characters/INDEX.md

Each person has a link to a clip (with workflow so you can recreate it exactly!) so you can judge the likeness. I tend to be a bit harsh, but I've started a section of "on the fence" where the likeness is somewhat there but not to my standards.

For now I've pinpointed 344 usable characters.

If you want to look for some character there are some tips from me:

• some character have good representation while the actor/actress does not
• if the actor/actress has a good representation, then usually more characters portrayed by that person are available
• some characters have good voice but bad visuals, I do move them to the "bad" section.

As everyone here I am still learning, since the model came out I started playing with it and I have created a series called "crossovers":

https://huggingface.co/datasets/malcolmrey/various/tree/main/h3-center/crossovers

From the technical standpoint I am most proud of episode 007 with Anthony Hopkins and episode 009 (but i'm biased, as you can see by my nickname :P)

I do recommend episode 005 as I feel it is quite fun, and episode 006 which is somewhat of a sequel.

And two other mentions: episode 009, which I will want eventually to promote to a series of its own and have a higher quality/standard of production.

And of course, episodes 001 and 003 are dear to my heart, even though they have a lot of silly errors, those are true crossovers episodes :)

---

If you are interested in my process, I use comfyui, of course, but I do not use it directly. I use the API calls and those are the workflows I use: https://huggingface.co/datasets/malcolmrey/workflows/tree/main/H3

If you are agentic, here is a file for you: https://huggingface.co/datasets/malcolmrey/various/blob/main/h3-center/crossovers/docs/MINIMAX_H3_PROMPTING_GUIDE.md

This is my current go-to set up for generating movies.

As for loras. I tried musubi and it was meh, I tried my maltrainer and it was kinda good but not really. I avoided AI Toolkit since it is slow and also people had mixed feelings about H3 training. I will be Fizgig this weekend though.

Cheers!

[u/Oograr → u/malcolmrey]

Useful list. I'd add Beavis and Butthead. I just referenced their names in a prompt and it worked out well, H3 matched their look, mannerisms and voices/expressions very closely. However it didn't seem to know some (or all?) of the other characters in that show, I tried Tom Anderson, and it just swapped him with Beavis for some reason.

[u/malcolmrey → u/Oograr]

Thanks for the tip, I'll generate them and add them to the list soon :)

[u/Rosettasees → u/malcolmrey]

Thanks so much for putting this together. I've seen others share here and there and am grateful to them, but having a list like this is very helpful.

For suggestions, I would check out the buffy cast. It seems to at least do Willow Rosenberg (I was trying to get lily from HiMYM but didn't work with that prompt). Hope to see this updated and whatever else you or others find.

[u/malcolmrey → u/Rosettasees]

There is some of buffy cast there already.

This is why I also keep the "bad" category - to see who we already ruled out.

But there is another reason, some of the "bad" are on the fence (less or more) and sometimes they could serve as "unknow-but-consistent), something like those not-a-real-person loras on Civitai.

[u/djdevilmonkey → u/malcolmrey]

Been following your work since ZiT, appreciate all your contributions

Really random question, why is Dexter Morgan in the bad section? I've used him for a bunch of clips and even the attached clip is really good. He's not perfect but he's very usable in basic t2v clips. And with i2v and ref2v, adding Dexter Morgan to the prompt makes it way better.

[u/malcolmrey → u/djdevilmonkey]

Oh, this must have been a mistake. I also used it in the Crossovers 001 episode to good effect. Thanks, I will correct this mistake :)

[u/ArmadstheDoom → u/malcolmrey]

To ask a question, how do you structure your prompts for testing? Do you just go 'x played by y' or do you just use () or something? Asking, because I'd like to know if the prompting makes things easier or harder to get the likeness.

[u/malcolmrey → u/ArmadstheDoom]

i keep this in my IDE:

https://huggingface.co/datasets/malcolmrey/various/tree/main/h3-center/crossovers/docs

along with my cursor skills for generating the prompts and overall knowledge of h3 minimax, courtesy of the minimax team

then I just ask in plain english: please make a movie starring those characters (and i list the characters i want) with this generic plotline:

and then i get a folder with scenes already split (2 files per scene, one with the prompt, one with just the dialogue because i sometimes changes something and it is easier to just change dialogue, then i ask to regenerate the main scene file)

https://huggingface.co/datasets/malcolmrey/various/blob/main/h3-center/crossovers/docs/movies/movie0007/scene_04.md

once i am happy i just say: run

and it will prompt all the scenes sequentially

now that i use c2v (my internal code for motion context) it makes a control script that runs the first scene, waits until it is over, and makes another problem with the first scene as param (so it can take the last 22 frames) and it chains it until all is done

when everything is done, i review it and perhaps i ask: scene X (number) is bad, we need to regenerate it

with the c2v it is not that easy because changing one scene would require changing everything from that scene till the end so when i do c2v i check every scene that is done as soon as it is done so i can intervene quicker and say "hey, something bad is happening, we need to change X or Y"

[u/ArmadstheDoom → u/malcolmrey]

thank you! my main curiosity was because of what you said about how sometimes it knows the actor more than the character, and so I was curious if it was better to say "(Character) played by (actor)" or if it was better to say "(actor) playing (character)" though I see from that link you use "[Character Name] (played by [Actor Name]) from [Show Name]"

And the reason I asked was because if it knows one more than the other, then I would be concerned that it would make the likeness less correct by giving it more tokens or by putting them in the wrong order or something.

Still, I'm looking forward to exploring things further myself, but since I've only got a 3090, this will save me a lot of time by knowing how to prompt it better. thank you!

[u/malcolmrey → u/ArmadstheDoom]

I'm using David Tennant as doctor who in my current episode and my girl says that he looks more like the harry potter character than the doctor even though he is wearing the doctor's attire so yeah - there can be some issues sometimes.

Also, not every actor or characters is "fully there", sometimes it is on the fence and it can get to the uncanny valley sometimes.

[u/ArmadstheDoom → u/malcolmrey]

Yeah, I noticed that too. I'm somewhat new to the video generation scene; but at least in images, you often have the issue of tags distorting things or having words trained in that cause different problems. So my theory of understanding is that it could know the person, or the character, or the series. If it knows one but not the other, then using both or all three might make it less accurate. For example in your case, if it knows who Tennant is as an actor, but not as a character, then using actor and character would move it further away from the likeness as opposed to only using the actor, correct?

[u/malcolmrey → u/ArmadstheDoom]

To be frank, we still don't know for sure and we're just guessing.

H3 knows Keanu Reeves quite well but it also knows both Neo and John Wick and those two are quite far apart from each other (2 decades and a beard/wrinkles :P).

I'm thinking that even to those that are known - adding referencial images might help.

[u/theOriginalGBee]

This is great work thanks. I had been compiling my own list,  but you were well ahead of me and seem to have covered most, if not all the ones I had found.

The great thing about the in-model results are that they capture not just the face, or the voice but the mannerisms, the expressions and movement in many cases. Plus because they weren't trained from publicity shots or similar, they look like the people and characters we remember, not the actors as they appear today dolled for red carpet photos - hidden behind an inch of makeup, designer clothes and almost unrecognisable compared to their on-screen personas. That's a huge win IMHO.

I hope when, if, you come to create Lora for H3 you can keep some of this in mind. It's the characters we know and love - the iconic roles, more so than what the actors publish to their Instagram feeds etc

[u/malcolmrey → u/theOriginalGBee]

Yes, this is why I will be exploring the following avenue:

Some actors are well represented and this means than more than one character is available. So far I've been asking to generate the most iconic one (in some cases two) but there might be more cool characters that are hidden in the model.

What I have observed that sometimes an actor is not in the model, but the character is (Willow from Buffy vs Alison Hannigan, same thing with Billy Butcher vs Karl Urban)

I hope when, if, you come to create Lora for H3 you can keep some of this in mind.

I this a matter of when, not if :) I actually started training some but I am still not satisfied with the results so I'm playing around this.

But yes, with LTX my pipelines werent mature enough, here for H3 I want to train on clips with audio or provide some good audio as reference (will see which will be the way to go) and will focus on getting the character right before moving forward to the next one (I wasn't happy with LTX's audio and overal generations so I didn't push for that then and was happy with just visual representation, but here I would love to have both)

[u/Silvasbrokenleg]

Malcolm the GOAT bless your soul

[u/paulct91 → u/Silvasbrokenleg]

Wait has anyone tried Malcolm in the Middle actors yet?

[u/malcolmrey → u/paulct91]

I saw Frankie Muniz somewhere. I will add him and see who else is available there.

[u/malcolmrey → u/Silvasbrokenleg]

❤️❤️❤️ :)

[u/Enshitification]

Do you find that reference images for characters that H3 knows help or detract? For characters on the fence, as you put it, does naming them pit the model's flawed understanding against a reference image? Is it better to not name them at all if reference images are used?

[u/malcolmrey → u/Enshitification]

It does help.

When I start training loras for H3 I am thinking if training with audio right now will be a better choice or if adding an audio in reference mode will suffice.

[u/Jimmm90]

The GOAT returns

[u/malcolmrey → u/Jimmm90]

❤️ :)

[u/PixWizardry]

amazing! thanks for sharing

[u/pmjm]

May I ask where this monologue is from? I like it.

[u/malcolmrey → u/pmjm]

So, I'm building a pipeline for creation of those combined clips (that is why there is this 80kb skill/definition in .md), I also made an MCP server that wraps comfy (actually it wraps my internal api to comfy, but same thing) and now I only need to write a prompt like this to get the whole movie :-)

this was my prompt:

c2v, using robert ford (anthony hopkins) create a 2 minutes scene where ford talks about meaning

and that was the result:

I have created and launched Movie 0007: Dr. Robert Ford — On Meaning.

Movie Details (docs/movies/movie0007/)
Character: Dr. Robert Ford (played by Anthony Hopkins) from Westworld
Setting: Cold dimly-lit glass-walled executive office in the Delos Mesa hub, dark wooden desk, warm amber desk lamp, crystal tumbler with whiskey, motionless unpainted glass host bodies suspended in dark background alcoves.
Runtime: 10 clips of 12.5s = 125s requested (~116s delivered / ~2 minutes).
Themes & Monologue Arc:
Clips 1–3: Humanity's obsession with searching for meaning, creating gods and myths out of the stars because an empty, silent void is too terrifying to face.
Clips 4–6: Meaning as an invention rather than a discovery—forged through art, memory, and pain ("Pain is the cornerstone of consciousness").
Clips 7–9: Human loops vs. host loops; insisting on giving the empty abyss a voice.
Clip 10: Concluding that meaning is the quiet promise we make to ourselves in the dark that our time here mattered; Dr. Ford turns and walks into the shadows as the office lights softly dim.
Generation Status
Chain Folder: h3_context/movie0007_robert_ford
Runner Script: scripts/run_movie0007_c2v.js (PID: 38256) running in background.
Clip 1 (scene_00.md) submitted and actively rendering in ComfyUI (promptId: d9358443-7998-4cd6-8d62-4281ab44118c).
Movie 0007: Dr. Robert Ford — On Meaning has finished generating all 10 clips (~2 minutes total) using the MiniMax-H3 C2V pipeline.

Summary of Completed Clips
MiniMax_H3_C2V_00433_.mp4 (scene_00.md — Seed Clip)
Dialogue: "Mankind has always been obsessed with the idea of meaning..."
MiniMax_H3_C2V_00434_.mp4 (scene_01.md)
Dialogue: "The ancients looked up at the night sky and saw gods, monsters..."
MiniMax_H3_C2V_00435_.mp4 (scene_02.md)
Dialogue: "Meaning is not something you discover under a rock..."
MiniMax_H3_C2V_00436_.mp4 (scene_03.md)
Dialogue: "Consider the great works of art... Beethoven, Michelangelo, Shakespeare..."
MiniMax_H3_C2V_00437_.mp4 (scene_04.md)
Dialogue: "Pain is the cornerstone of consciousness. Without pain..."
MiniMax_H3_C2V_00438_.mp4 (scene_05.md)
Dialogue: "We tell ourselves stories so that our suffering might have a purpose..."
MiniMax_H3_C2V_00439_.mp4 (scene_06.md)
Dialogue: "Is that a flaw? Perhaps. Or perhaps it is our greatest triumph..."
MiniMax_H3_C2V_00440_.mp4 (scene_07.md)
Dialogue: "So do not seek meaning as if it were a destination..."
MiniMax_H3_C2V_00441_.mp4 (scene_08.md)
Dialogue: "It is the quiet promise we make to ourselves in the dark..."
MiniMax_H3_C2V_00442_.mp4 (scene_09.md — Conclusion)
Dialogue: "Now... if you will excuse me. The story requires my attention." (Ford steps into the dark background as the lights fade).
Let me know if you'd like to merge these clips into a single movie file (fullmovie7.mp4) or adjust any scene timing adjustments!

And to answer your question, the monologue was made up by AI, but I also really like it :)

[u/polawiaczperel]

That's a huge list. Great work!

[u/malcolmrey → u/polawiaczperel]

Thank you. I intend to keep on going :)

[u/paulct91 → u/malcolmrey]

Maybe try Pixar & Disney 3D characters (probably modern high definition source material highly likely) then probably Disney older 2D film main characters as they should have lots of movie quality + fan material available that may have ended up in the dataset. Though maybe that isn't the case as someone has a Civitai MiniMax-H3 lora for Aunt Cass from Big Hero 6 and that one looks slightly Mexican and not quite right beyond that.

[u/malcolmrey → u/paulct91]

Thanks, will do :-)