stable-diffusion text-to-image

pony-diffusion-g5-lora - LoCon saves the Unity Crystals

pony-diffusion-g5-lora is a latent text-to-image diffusion model that has been conditioned on high quality pony images through fine-tuning using LoCon from LyCORIS's implementation.

Finetuned for MLP G5 characters, based on AstraliteHeart/pony-diffusion. No furries, no NSFWs, just pure pones

The model is LoRA-only. See Files tab for downloads.

!! IMPORTANT: Add tag "pony" in prompt can DRAMATICALLY improve image quality

<img src="https://huggingface.co/GrieferPig/pony-diffusion-g5-lora/resolve/main/doc/demo1.png" width=50% height=50%> <img src="https://huggingface.co/GrieferPig/pony-diffusion-g5-lora/resolve/main/doc/demo2.png" width=50% height=50%> <img src="https://huggingface.co/GrieferPig/pony-diffusion-g5-lora/resolve/main/doc/demo3.png" width=50% height=50%>

(ignore his red hair plz it's a teeny tiny training error)

<img src="https://huggingface.co/GrieferPig/pony-diffusion-g5-lora/resolve/main/doc/demo4.png" width=50% height=50%> <img src="https://huggingface.co/GrieferPig/pony-diffusion-g5-lora/resolve/main/doc/demo5.png" width=50% height=50%>

Dataset criteria

All training images are from Derpibooru using the search criteria below

"{character_name}, safe, solo, score.gte:150, -webm, -animated, -oc, -g4 || {character_name}, suggestive, solo, score.gte:150, -webm, -animated, -oc, -g4 "

where {character_name} will be replaced by one of the following: sunny starscout, izzy moonbow, pipp petals, zipp storm, hitch trailblazer, misty

How to use LoCon in A1111's sd-WebUI

Since LyCORIS's implementation isn't support by WebUI officially, you have to load it through extensions like a1111-sd-webui-lycoris or sd-webui-additional-networks. Also, you have to use AstraliteHeart/pony-diffusion because these LoRAs are based on it.

Thanks

AstraliteHeart/pony-diffusion, for providing a solid start-point to train on

This project would not have been possible without the incredible work by the CompVis Researchers.

With special thanks to Waifu-Diffusion for providing finetuning expertise and Novel AI for providing necessary compute.


license: bigscience-bloom-rail-1.0