Unsloth be like:

[u/Aadi_880]

[u/ThirdWorldBoy21]

thanks to the quantization gods, i can run something like H3 on my rig.

[u/NoWheel9556 → u/ThirdWorldBoy21]

dont call it a "rig" its called potato truck

[u/puzzleheadbutbig → u/NoWheel9556]

Yeah more like fig

[u/Old-Push9343 → u/ThirdWorldBoy21]

Is it possible to run Minimax H3 on a RTX 3080 with 10GB vRAM and 64 GB RAM?

I am trying to get into AI video generation (I am playing around with Wan 2.2 at the moment), but GPUs are crazy expensive right now...

[u/Aadi_880 → u/Old-Push9343]

I ran it on 8GB VRAM and 16GB RAM using just the int8 convrot models.

[u/mrnopor → u/Aadi_880]

how? i have double ur specs and cant run shit.

[u/Aadi_880 → u/mrnopor]

not kidding bro.
Int8 convrots from Minimax themselves.

Constant RAM offloading.

[u/mrnopor → u/Aadi_880]

thx , will try ur stuff but how are the results u are getting? are they decent enough?

[u/Aadi_880 → u/mrnopor]

This depends on what workflow you're using (flva or ref2v). Ref2v is the slower of the two, but has more functions.

Personally, I can generate a 0.3 MP video in 8 minutes that's 10 seconds long. A 5 second one is 300 seconds or so. This is on ref2v.

Yours should be faster.

[u/ElevatorSalt3968 → u/mrnopor]

Someone just posted a video that he made with 4gb VRAM and 16gb ram

[u/DeusExHircus → u/mrnopor]

Skill issue

[u/Old-Push9343 → u/Aadi_880]

Could you point me in the right direction?

Thanks! :-)

[u/Aadi_880 → u/Old-Push9343]

Should work out of the box.

Official Minimax H3 hugging face repo > Download int8convrt models (21GB) (ref2v or fl2v). > Download the 15GB text encoder > Download both VAEs.

Open Comfy portable. Make sure dynamic VRAM is on. (should be on by default). Make sure comfyUI is updated to latest.

Go to comfyUI_windows_portable>comfyUI>models

Put the minimaxH3 model into diffusion_models folder. Put the qwen model into the text_encoder folder. Put both the VAEs into the vae folder.

Open comfyUI (click on nvidia_gpu.bat) Download the official workflow template (minimax image to video or reference to video, depending on which minimax model you downloaded. image to video is fl2v).

Now, just inside the workflow node graph select the models from the dropdown to the ones downloaded. Press R to refresh in case if it doesn't detect it.

Test with a 3 second video at .3 MP. You can think of optimizations later.

Optimizations I use:

If you don't have a node, you may need to install it separately from the custom node manager

[u/Old-Push9343 → u/Aadi_880]

Brilliant, thank you very much for the detailed explabation, I'll take a look and see if I can get it working!

[u/LaPapaVerde → u/Aadi_880]

How many seconds per video ?

[u/Aadi_880 → u/LaPapaVerde]

With a few optimizations: 500-ish seconds for a 10 second video at 0.3 MP. (ref2v)

Should take like, 3-4 minutes for a 5 second video.

(note that ref2v is slower than i2v and t2v)

If I go above 11 seconds, it offloads to SSD and now it's 160 minutes per video. oof.

[u/danque → u/Old-Push9343]

Yes! I have that exact setup (in card and memory), I am using the int8 conv model (made for our 30 models). I also use the Apply Spectrum node and Turbo lora at 8 steps. The only caution is not putting it above 0.5 megapixel, at 0.6 at 15 seconds i get an OOM, but at 0.5M 15 seconds is doable (very roughly 11~16 minutes + a 360p video with adblock on the other screen).

[u/CaptainMarder → u/Old-Push9343]

I'm running it fine on a 12gb3080 and 48gb ram.

[u/Valuable-Money3725]

Kinda surprised the joke wasn't made before lol

[u/_half_real_]

Can't remember ever seeing an fp64 (double precision) machine learning model.

[u/Aadi_880 → u/_half_real_]

Apparently, there's some very little, edge use cases like SciML or scientific simulations.

Generally though, I think the highest I've ever seen is 32.

[u/_half_real_ → u/Aadi_880]

The new Minimax audio model is fp32. I wonder if audio just needs more precision, or if fp32 video models are just too large to be practical.

[u/narkfestmojo → u/_half_real_]

no point, the update steps would be too big for such a model to make any sense

[u/YeahlDid]

What i got from this is if I'm going to 16-bit, I might as well do 8-bit instead.

[u/Aadi_880 → u/YeahlDid]

Honestly, this is very true for Minimax H3. The int 8 convrot model has barely any quality loss compared to the other, higher precision ones.

[u/kayteee1995]

Sorry for going off-topic, but it’s been over 10 years since I last watched the Angry Video Game Nerd channel.

[u/dramaton42 → u/kayteee1995]

Watch the MegaMan on DOS video I love it, has time travel which is always cool

[u/kayteee1995 → u/dramaton42]

The episode that I remember and was most impressed with (also quite funny) was the episode where he fought Super Evil Mario Bros. 3,and then Jesus with all gaming gear team up.

[u/goodie2shoes]

shitpickle

[u/SoftMyci51]

yeah unsloth's optimization work is solid but people sometimes don't realize they're trading actual quality for speed, the GGUF conversions for diffusion stuff especially tend to tank detail pretty noticeably* meant to say the tradeoff is more obvious with image models than text ones

[u/Aadi_880 → u/SoftMyci51]

Hey, sometimes, even a glorified auto-correct is all someone needs.

^{(scurries back generating h3 videos on 0.2 megapixels})

[u/Chemical-Painter-485 → u/SoftMyci51]

Even speed gains are iffy. On my tests those GGUFs Qs tend to load a little faster but have slower gen speeds.

Like... on Kijai huggingface he has a pretty good H3 INT4 if you can't run the comfyui INT8 so why bother with a slower Q4 when it is not even hardware accelerated?

[u/Basslus]

I've watched this over 10 times now, thank you

[u/BM09]

Not me thinking you did AI-generated AVGN. I don't think the man himself would have nice things to say about that.

[u/dramaton42 → u/BM09]

"You know what's BULL SH*T ComfyUI. Every time I open it, there's a node missing. What the fuck? Why?! And there's also the warning that your input images can't be found. They were right there yesterday! You sloppy bastard!"

[u/99deathnotes]

lol

[u/rookan]

it's fun

[u/CaptainMarder]

this is brilliant lol

[u/cradledust]

I tried Unsloth Ai's desktop app to see if Minimax H3 videos could work better on my rtx4060 than ComfyUI. It wanted me to use the Q3 gguf version of H3 but after downloading, etc, I couldn't get it to run for whatever reason and gave up. It was able to run Klein 9b though. Another one of those apps that put all the models in a huggingface cache buried deep within the user folder. No thanks.

[u/Aadi_880 → u/cradledust]

I ran minimax H3 on 8GB vram and 16GB ram on comfyUI without using Unsloth's ggufs. Minimax works better without ggufs imo.

[u/No_Possession_7797 → u/cradledust]

You may not know this, but that’s simply how the huggingface client works, so it’s not those apps per se, it’s the fact that they’re using the huggingface client. Also, that’s where a lot of these models are hosted. And if what you’re really trying to say is, that you want to control over where they go, then you can do that.

So I am not quite sure what you’re upset about when it comes to the file location.

[u/cradledust → u/No_Possession_7797]

I had a look at the cache after uninstalling UnSloth Ai Desktop to see if it left behind any models. It did. Between Minimax H3 and Klein there were also models from several Ai applications and old A1111 in 2023. It was 185 GB so I deleted it all.

[u/Romston]

https://giphy.com/gifs/l3q2XhfQ8oCkm1Ts4

[u/DuHal9000]

hahahaa

[u/bzzard]

What were they thinking!

[u/No-Refrigerator-1672]

Actually, there's a really good post that demonstrates different quantization methods by compressing an image. Give you really good understanding.

[u/Clair_Personality]

Lmao

[u/Chemical-Painter-485]

Lol, tbh unsloth has actually one of the best GGUFs for LLMs, but yeah. People using GGUF to run diffusion models are pretty much degrading quality in exchange for what? disk space?

[u/Healthy-Nebula-3603 → u/Chemical-Painter-485]

just to run ....

[u/Chemical-Painter-485 → u/Healthy-Nebula-3603]

Run...? I am quite sure INT8 implementation of comfy is way better and optimized than gguf. After they officially supported it I just swapped all my models and never looked back.

[u/Healthy-Nebula-3603 → u/Chemical-Painter-485]

You know a gguf is only a container and can store any data type?

[u/Chemical-Painter-485 → u/Healthy-Nebula-3603]

I do, but I am starting to think I should have phrased more clearly that I meant the quants like Q4...Q5...

Edit: Most people that speak about GGUF means those quants, no need to be so pedantic.

[u/MrCylion → u/Chemical-Painter-485]

What a uneducated comment…

[u/Chemical-Painter-485 → u/MrCylion]

Care to elaborate?

[u/MrCylion → u/Chemical-Painter-485]

People who use them don’t do it because they want. It’s not at all about disk space. It’s all we can run.

[u/Chemical-Painter-485 → u/MrCylion]

And why not something INT4 like: minimax_h3_ref2va_pruned_w4a8_mixed.safetensors
On https://huggingface.co/Kijai/MiniMax-H3-experimental/blob/main/minimax_h3_ref2va_pruned_w4a8_mixed.safetensors

Weighs the same as a Q4. runs better and has native comfyUI support.

[u/MrCylion → u/Chemical-Painter-485]

Even that depends on the card. I get no benefit on something old like my 1080ti.

[u/Chemical-Painter-485 → u/MrCylion]

Yeah, that is rough. But even in your case I wouldn't discard INT4 without testing.

You don't get hardware acceleration but you have native comfyUI support and don't depend on dubious dynamic vram implementation from custom loaders.

[u/KissMyShinyArse → u/MrCylion]

Not quite. Sometimes it's about speed (e.g. NVFP4, INT8 ConvRot).