How to Convert Your Trained FLUX, Stable Diffusion 3.5, SDXL and Other LoRAs Into FP8 and FP16 to Save Huge Space With Kohya GUI

Patreon exclusive posts index to find our scripts easily, Patreon scripts updates history to see which updates arrived to which scripts and amazing Patreon special generative scripts list that you can use in any of your task.

Join discord to get help, chat, discuss and also tell me your discord username to get your special rank : SECourses Discord

Please also Star, Watch and Fork our Stable Diffusion & Generative AI  GitHub repository and join our Reddit subreddit and follow me on LinkedIn (my real profile)

=======

10 December 2024 Update

• Screenshot updated according to latest version

Details

• As you know I have finalized and perfected my FLUX LoRA Training workflow until something new arrives

• Configs and necessary explanation are shared here : https://www.patreon.com/posts/110879657

• LoRA full tutorial : https://youtu.be/nySGu12Y05k

• Fine Tuning / DreamBooth full tutorial : https://youtu.be/FvpWy1x5etM

• LoRA Extract from Fine-Tuned / DreamBooth checkpoint : https://www.patreon.com/posts/112335162

How To Reduce LoRA Model Files Size

• There are 3 ways of reducing generated / save LoRA models

• 1 : When training, you can reduce LoRA Network Rank (Dimension)

  • I don't recommend this since it reduces the quality

• 2 : Saving as FP16 when training

  • This makes it half but still files will be big, almost no quality loss as shown in below grid

• 3 : Saving as FP8 after trained as shown in above images via Kohya GUI

  • As shown in below grid almost best quality and 2.5 GB FP32 LoRA file becomes 634 MB

• Full grid that shows FP8 vs FP16 vs FP32 : LoRA_Precision_FP8_vs_FP16_vs_FP32_Grid.jpg

• With this way you can convert any model LoRAs like:

  • Stable Diffusion 1.5 (SD 1.5), Stable Diffusion XL (SDXL), Stable Diffusion 3 or Stable Diffusion 3.5 (SD 3.5), FLUX and such

• However how other architectures like SDXL will perform need to be grid tested