Experimenting With OneTrainer - OneTrainer vs Kohya - Realism vs Stylization - Reg images vs No-Reg images
Experimenting With OneTrainer - OneTrainer vs Kohya - Realism vs Stylization - Reg images vs No-Reg images
I feel like reg images using in OneTrainer improved realism and also lessened the overfitting as expected
OneTrainer realism looks better than Kohya meanwhile Kohya generalization looks better
Download attached images to see full resolution
OneTrainer Stable Diffusion XL (SDXL) Fine Tuning Best Presets
Massive 4K Resolution Woman & Man Class Ground Truth Stable Diffusion Regularization Images Dataset
The Very Best Workflow For SDXL DreamBooth / Full Fine Tuning - Results Of 100+ Full Trainings
Comments (12)
Big improvements to realism. Is there a runpod installer script for OneTrainer?
Sadly not because it requires a Desktop GUI. I plan to research for such template on RunPod.
you can train on Pixart using onetrain, i just started the training not sure about the results
yes they recently merged into code and I plan to do hopefully soon
Did you get a chance to test with the face masking feature?
not yet sadly.
Any chance to get a SD 1.5 config?
still working on that. so sorry that i still couldn't release
I love my Kohya, no ty. If I wanna generalization, I just train on sdxl dpo... I believe style loras are better without generalization.
ye kohya is great too
Do you explain anywhere how you incorporated reg images? Did you just make a concept for "Regularisation images", put 3k images in there w/o captions (or maybe a single caption txt file w/ the class name? ie "Person"?) Also have you used captions or a single caption txt for your trials so far? I got really nice results w/ your configs already, but I only put a simple txt file w/ the subject (trigger) name in it - I never captioned w/ kohya for single likenesses. Lastly, per the developer in that thread you created on their github I tried mask traininng last night and had good results. I used the "remgb" option and it quickly made masks for just the person - pretty cool. Do you know in that case if it just looks at the person, or does it look at both but can differentiate better? I don't believe Kohya has a masking feature so I wanted to try it. I'm so glad you picked this to look into. I see others asking for different things, but for me this is the best topic you've taken on after Kohya's training. Plus the OT developer is so active that I'm sure he'll be very quick to add support for future models (OT supports PicsArt training, Wurscher training, etc - dev is all in w/ the different models).
1 : added our reg images as new concept but made the repeat 0.003. so 0.003 * 5200 = 15 images used each epoch 2 : i only have a txt file for training dataset that has ohwx man and for reg images just man. so a single txt file that contains the rare token and class token 3 : i didnt try masking yet. i don't think it will improve quality. do you have good results with it? i believe better dataset better than masking
