Kandinsky text-image text2image diffusion latent diffusion mCLIP-XLMR mT5

Kandinsky 2.0

Kandinsky 2.0 — the first multilingual text2image model.

Open In Colab

GitHub repository

Habr post

Demo

UNet size: 1.2B parameters

NatallE.png

It is a latent diffusion model with two multi-lingual text encoders:

These encoders and multilingual training datasets unveil the real multilingual text2image generation experience!

header.png

How to use

pip install "git+https://github.com/ai-forever/Kandinsky-2.0.git"

from kandinsky2 import get_kandinsky2
model = get_kandinsky2('cuda', task_type='text2img')
images = model.generate_text2img('кошка в космосе', batch_size=4, h=512, w=512, num_steps=75, denoised_type='dynamic_threshold', dynamic_threshold_v=99.5, sampler='ddim_sampler', ddim_eta=0.01, guidance_scale=10)

Authors