KerasCV Stable Diffusion in Diffusers 🧨🤗

DreamBooth model for the puggieace concept trained by nielsgl on the nielsgl/dreambooth-ace dataset. It can be used by modifying the instance_prompt: a photo of puggieace dog

Description

The pipeline contained in this repository was created using a modified version of this Space for StableDiffusionV2 from KerasCV. The purpose is to convert the KerasCV Stable Diffusion weights in a way that is compatible with Diffusers. This allows users to fine-tune using KerasCV and use the fine-tuned weights in Diffusers taking advantage of its nifty features (like schedulers, fast attention, etc.). This model was created as part of the Keras DreamBooth Sprint 🔥. Visit the organisation page for instructions on how to take part!

Examples

Portrait painting of a cute puggieace dog as a samurai

Photo of cute puggieace dog as an astronaut, space and planet in background

A photo of a cute puggieace dog getting a haircut in a barbershop

Portrait photo of puggieace dog in New York

Portrait of puggieace dog as a Roman Emperor, city in background

Usage

from diffusers import StableDiffusionPipeline

pipeline = StableDiffusionPipeline.from_pretrained('nielsgl/dreambooth-keras-pug-ace-sd2.1')
image = pipeline().images[0]
image