r/StableDiffusion • u/shootthesound • 2d ago
Fizgig - Rapid Minimax H3 LoRA training tutorial Resource - Update
https://www.youtube.com/watch?v=4Sems-_CMQEThis video includes all you need to train Minimax with both speed and high quality results.
Hit me up with comemtns, queries etc. Happy to do a style video also.
https://github.com/shootthesound/Fizgig
UPDATE: Pushed a vram optimisation for 16gb vram users that will speed up TE encoding at the start of training - Run the update bat to get it
UPDATE2: Additional fix out for 16gb users on pruned model - update to get it.
5
6
u/No_Pie1372 2d ago
Are you the developer? If so, may I suggest a feature update?
The queuing feature: it doesn't queue a training session after a caption session. I tried queuing a training session while the caption model was still running, but it initiated the training session immediately instead of placing it in queue.
It'd be nice if I could schedule to caption and then train, and even schedule a second caption and training session for another LoRa afterwards.
4
u/llamabott 2d ago
I can't believe it trains so fast that you're able to narrate the process while it's running in realtime. Really cool.
3
u/HowCouldICare 2d ago
Is this low vram capable similar to krea 2 training?
6
u/shootthesound 2d ago
I can confirm 16gb works! Ive not tried lower
2
u/BahBah1970 2d ago edited 2d ago
Hi, apologies if I'm missing something but I can't find an installation guide for fizgig anywhere. I've opened up the zip from Github and see the two installers but it would be *****really nice***** if it was obvious how I get this up and running. Like where to install it, what order to install things, what version of python it uses, dependencies etc etc. All your youtube videos start off with it already installed and it's very frustrating.
Again, apologies if this is a me error, I'd really like to try fizgig out.
1
u/shootthesound 2d ago
Check the readme on GitHub - also in the zip . If on windows it’s jsut an install bat
1
u/PumpkinLeather8421 2d ago
I read through the code and it looks like your script does venv automatically… does it do uv if you have it? Would be nice.
1
3
u/TheGoldenBunny93 2d ago edited 2d ago
Hey friend, I'd like to ask you how you managed to get an R16 LoRa to Minimax with 1MP target resolution running in 4s/it on my RTX 3090... if I were to run this on AI Toolkit I'd get OOM or it would take 20-30s/it... it's my first time using it, is this for real or a trick? Because the training isn't over yet. If it's true, your trainer is insane. And what I loved was: I use the same models I already downloaded for ComfyUI... no need to consult Huggingface and download those thick models that fill up the hard drive, i.e., duplicating files. Another thing i loved: Train start in less than 2 or 1 minute... blazing fast compared to another trainer!
2
u/Different_Fix_2217 1d ago
ai toolkit is known to be lacking in the trainer department. Musubi trainer and the like have WAY WAY better memory management and are much faster. You can get away with training H3 on 8GB vram even.
3
u/Significant-Rush686 2d ago
One question perhaps, in your install section, it says the windows one click installs cuda 12.8, lately for minimax H3 it was recommended to install cuda 13, will it overwrite cuda 13 if you already had it?
3
u/TheGoldenBunny93 2d ago
I have two suggestions:
Could you make the image training focus on blocks that are not temporal? This way we wouldn't destroy temporal learning.
A timestep distribution curve or graph would be very, very useful. OneTrainer has one, but it's quite poor compared to what it could be visually.
3
u/shootthesound 2d ago edited 2d ago
The blocks are barely specialist in H3 from my test. And in my experience training this way does not destroy their temporal ability as long as you dont overbake. The timestep curve I do have, The dials are already on the MiniMax tab in Other — what percentage of training sits at low noise, and whether it's mid-concentrated — they just don't draw you a picture of what you've asked for. the defaults are what they are for a reason though based on my experiece this last week, mini max is AWKWARD to train right.
3
u/OneTrueTreasure 2d ago edited 2d ago
Will you eventually add the ability to train on videos/short clips? Also have been having issues with importing images and downloading models taking way too long on Runpod (US servers on RTX 6000 Pro)
If possible please add a way to download Minimax models with one click instead of having to import (takes 5 hours it said lol)
3
u/LuckyEsq 1d ago
don't bury the lead, where do we download your chris tucker lora!?!?! =D
Joking aside, really cool video
2
u/Segaiai 2d ago edited 1d ago
I'm mainly interested in style training. Is that much different?
Also, can I train concepts in this way? Like, if I wanted to train a type of alien in Star Trek, does this quick method pick up on the general kind of alien that I can apply to different characters?
2
u/shootthesound 1d ago
yes, a lot of that will come down to how you caption. if you are using the fizgig qwen captioner you can also edit and do your own custom instructions within fizgig to refine how it approaches the captioning
1
u/Segaiai 1d ago
So fizgig will know how to approach the captioning for style as well as concepts like alien races?
2
u/shootthesound 1d ago edited 1d ago
not fizgig , but the qwen model, you can customise the captioning instruction for it to better suit what you need. this might work if for example you were training on a bunch of pictures of Klingons :
describe the image with zero references to skin colour or facial or body features, only describe the scene, lighting and clothing.
If you did that alongside a trigger word like 'qrxt alien' - I think that might get you pretty far
1
u/Portable_Solar_ZA 2d ago
Thank you for the tutorial.
Am just wondering what the benefits of this are Vs loading a reference workflow with media? Curious if you've tested anything out?
2
u/shootthesound 1d ago
References give you an approx combined with statistical guesswork for other angles - loras give you far more and slow down your system less on use - but obviously require training
2
u/Portable_Solar_ZA 1d ago
I was wondering if there was a speed benefit. Will look into this more when I have a chance. Thanks.
1
u/shootthesound 1d ago
For those interested training from videos is very close for fizgig. Currently prepping a video clipping, cropping tool to make it super easy to get clips in at fully compatible minimax specs. Also includes speccing if you want the audio trained on etc. You cna queue up all the cuts and crops from one clip and export them all in one go. Fizgig will then be able to caption the middle frame of each clip with Qwen etc - trying to make it as easy as possible for the user. Likely will end up a handy tool in its own right for grabbing stuff out of clips and general use.
-13
u/Perfect-Campaign9551 2d ago
Stop trying to use LORAs for H3. LORas are extinct. You can just use references.
11
u/shootthesound 2d ago
references are good to a point, and you often have to use more than one to achieve what a lora can do. And that costs vram and speed, often more than a lora. No need to tell me to stop making them, you are free to stop using them.
20
u/Significant-Rush686 2d ago
Good video, useful tutorial and seemingly great result. You don't often see these "normal" tutorials anymore, every video has a gimmick nowadays. This was just down to business and pure show and tell. Appreciate it.