sdxl-ugly-sonic-lora

作者 minimaxir · 下载 1025 · 点赞 3 · 更新 2023-11-03

stable-diffusion stable-diffusion-diffusers text-to-image diffusers lora

sdxl-ugly-sonic-lora

sdxl-ugly-sonic-lora 预览 1

A LoRA for SDXL 1.0 Base which generates Ugly Sonic, using sonic the hedgehog as the trigger keywords.

Usage

The LoRA can be loaded using load_lora_weights like any other LoRA in diffusers:

import torch
from diffusers import DiffusionPipeline, AutoencoderKL

vae = AutoencoderKL.from_pretrained(
    "madebyollin/sdxl-vae-fp16-fix",
    torch_dtype=torch.float16
)
base = DiffusionPipeline.from_pretrained(
    "stabilityai/stable-diffusion-xl-base-1.0",
    vae=vae,
    torch_dtype=torch.float16,
    variant="fp16",
    use_safetensors=True
)

base.load_lora_weights("minimaxir/sdxl-ugly-sonic-lora")

_ = base.to("cuda")

During image generation, use sonic the hedgehog in the prompt.

Examples

For all generations, the negative prompt used is blurry, low quality. Prompt weighting is done using the compel syntax.

sonic the hedgehog relaxing on a couch, renaissance painting, (oil on canvas, aged, worn)++++ (cfg = 13)

sdxl-ugly-sonic-lora 预览 2

a profile of sonic the hedgehog sitting at a desk deep in thought, (pixel art)++++, award-winning photo for vanity fair (cfg = 13)

sdxl-ugly-sonic-lora 预览 3

anatomical diagram of sonic the hedgehog, (highly detailed)++++ (cfg = 13)

sdxl-ugly-sonic-lora 预览 4

sonic the hedgehog (eating at McDonald's)++, Ukiyo-e, minimalistic vector art (cfg = 13)

sdxl-ugly-sonic-lora 预览 5

(hyperrealistic++ death metal album cover)+++ featuring edgy moody realistic human sonic the hedgehog, edgy and moody (cfg = 13)

sdxl-ugly-sonic-lora 预览 6

(hyperrealistic tall human)+++ sonic the hedgehog cameoing in an (episode of Friends)+++++, high quality hyperrealistic promotional photo (cfg = 13)

sdxl-ugly-sonic-lora 预览 7

Methodology

This LoRA was trained on frame-by-frame analysis of the original 1080p trailer featuring "Ugly Sonic". Square-crops of Ugly Sonic were extracted and AI-upscaled to 1024x1024 for optimial training.

The use of sonic the hedgehog as the trigger keywords (and training the LoRA on said keywords) ensures that you won't generate the other hedgehog by accident. Because no one likes him.

Notes