text-to-image stable-diffusion

<u>🎈 FlexDreamHK</u>

<img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/banner2.png" width="100%" height="100%">

<b>FlexDreamHK</b>は<b style="color:#dc143c;">リークされたNovelAIモデルの入っていない、あるいはそのリスクを可能な限り低くしたモデルを目指して作成</b>しました。<br><br> 　モデル名はマージに使用したモデルたちに敬意を表し、主要なモデル名を組み合わせて命名しています。<br><br> 　マージ元となったモデルはStable DiffusionやWifu Diffusionへの追加学習（ファインチューニング）を行ったもののみで構成されています。<br> 　また、にじジャーニーと普段使いしているモデルから生成した絵から絵柄LoRAを作成・マージしており、いわゆる<b style="color:#4753a2;">蒸留系と呼ばれるモデル</b>でもあります。<br><br> 　マージの過程と使用したLoRAそのもの、またそれを作成した際のデータセットを開示する事で可能な限り透明性を担保しました。

🎀 特徴

<ul> <li style="color:red;font-weight:bold;">得意なこと</li> <ul>
<li>太めの主線でパッキリとしたアニメ調のイラスト</li> <li>soloのかわいい女の子が出しやすい</li> <li>ある程度のNSFWへの対応</li> <li>ある程度の呪文の効きやすさ</li> <li>キャラクターイラストに特化した絵の生成</li> </ul> <li style="color:blue;font-weight:bold;">苦手なこと</li> <ul> <li>濃いめの影が落ちやすい</li> <li>複数人が登場する絵は出しづらい</li> <li>男性の絵は苦手</li> <li>danbooru以外のタグは効き目が薄い（色指定などが顕著）</li> <li>表情の多様性にやや欠ける</li> <li>背景メインのイラストは苦手</li> <li>手指含めて細部の破綻が比較的多め</li> </ul> </ul>

👉 推奨設定

<ul> <li>clip skip:2 / VAE不要</li> <li>顔が溶ける場合は拡張機能<a href="https://github.com/Bing-su/adetailer">adetailer</a>の使用がオススメです</li> <li>推奨ネガティブ(nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35)</li> </ul>

履歴

<table> <tr> <th>日付</th> <th>内容</th> <tr> <td>2023/07/29</td> <td>FexDreamHK_v2.0 サンプル画像アップ</td> </tr> <tr> <td>2023/07/28</td> <td>FexDreamHK_v2.0 公開</td> </tr> <tr> <td>2023/07/07</td> <td>FexDreamHK_v1.0 公開</td> </tr> </table>

⭕ ライセンス / License

<b>creativeml-openrail-m</b>

<div class="px-2"> <table class="table-fixed border mt-0 text-xs"> <tr> <td class="align-middle px-4 w-8"> <span class="text-green-500"> <h5>OK</h5> </span> </td> <td> 著作者表記を入れずにモデルを使用する<br> Use the model without crediting the creator </td> </tr> <tr> <td class="align-middle px-4 w-8"> <span class="text-green-500"> <h5>OK</h5> </span> </td> <td> このモデルで生成した画像を商用利用する<br> Sell images they generate </td> </tr> <tr> <td class="align-middle px-4 w-8"> <span class="text-green-500"> <h5>OK</h5> </span> </td> <td> 商用画像生成サービスに、このモデルを使用する<br> Run on services that generate images for money </td> </tr> <tr> <td class="align-middle px-4 w-8"> <span class="text-green-500"> <h5>OK</h5> </span> </td> <td> このモデルを使用したマージモデルを共有・配布する<br> Share merges using this model </td> </tr> <tr> <td class="align-middle px-4 w-8"> <span class="text-green-500"> <h5>OK</h5> </span> </td> <td> このモデル、または派生モデルを販売する<br> Sell this model or merges using this model </td> </tr> <tr> <td class="align-middle px-4 w-8"> <span class="text-green-500"> <h5>OK</h5> </span> </td> <td> このモデルをマージしたモデルに異なる権限を設定する<br> Have different permissions when sharing merges </td> </tr> </table> </div>

ver2.0

🍳 レシピ / Recipe

<div class="px-2"> <div class="border p-2"> <details> <table> <thead> <tr> <th>A</th> <th>B</th> <th>C</th> <th>weight</th> <th>OUTPUT</th> </tr> <tr> <td>FlexDreamHK_v1.0</td> <td><a href="https://huggingface.co/sazyou-roukaku/LittleStepMix">LittleStepMix_A</a></td> <td></td> <td>Weight sum cosineA 0.5</td> <td>FlexDreamHK_2.0_orig</td> </tr> <tr> <td>FlexDreamHK_2.0_orig</td> <td></td> <td></td> <td>adjust 0,0,0,0,1,1,2</td> <td>FlexDreamHK_v2.0</td> </tr> </tbody> </table> </details> </div> </div>

<details> <summary>🎨 サンプル</summary> <img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/ver20_grid-0000.png" width="100%" height="100%"> <pre style="white-space: pre-line;" class="w-full"> 1girl, solo, from above, blonde hair, short ponytail hair, amber eyes, small breasts, armored dress, outdoors, fantasy castle, nervous, nice hands Negative prompt: (nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35), demon horns Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3921621133, Size: 512x512, Model hash: e2c364c195, Model: FlexDreamHK_v2.0, Denoising strength: 0.6, Clip skip: 2, Hires upscale: 2, Hires steps: 10, Hires upscaler: lollypop, Version: v1.3.1 </pre> <img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/ver20_grid-0001.png" width="100%" height="100%"> <pre style="white-space: pre-line;" class="w-full"> <a href="https://twitter.com/Emanon_14/status/1684944352161026049">エマノンさんから呪文お借りしてます</a> 1girl, smile, sitting, poncho, frills, gothic, snowflakes, winter, campfire, polar bear Negative prompt: (nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35) Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3452924181, Size: 512x512, Model hash: e2c364c195, Model: FlexDreamHK_v2.0, Denoising strength: 0.6, Clip skip: 2, Hires upscale: 2, Hires steps: 10, Hires upscaler: lollypop, Version: v1.3.1 </pre> <img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/ver20_grid-0002.png" width="100%" height="100%"> <pre style="white-space: pre-line;" class="w-full"> 1girl, solo, flower, japanese clothes, hair ornament, long hair, hair flower, kimono, smile, looking at viewer, white flower, floral print, red flower, very long hair, jewelry, earrings, hakama, bangs, closed mouth, blue eyes, braid, hakama skirt, skirt, blush, long sleeves, red hakama Negative prompt: (nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35) Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4251802516, Size: 512x512, Model hash: e2c364c195, Model: FlexDreamHK_v2.0, Denoising strength: 0.6, Clip skip: 2, Hires upscale: 2, Hires steps: 10, Hires upscaler: lollypop, Version: v1.3.1 </pre> <img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/ver20_grid-0003.png" width="100%" height="100%"> <pre style="white-space: pre-line;" class="w-full"> multiple girls, 2girls, cat, blue hair girl and pink hair girl, long hair, ahoge, school uniform Negative prompt: (nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35) Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 434535967, Size: 512x512, Model hash: e2c364c195, Model: FlexDreamHK_v2.0, Denoising strength: 0.6, Clip skip: 2, Hires upscale: 2, Hires steps: 10, Hires upscaler: lollypop, Version: v1.3.1 </pre> </details>

ver1.0

<img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/banner.jpg" width="100%" height="100%">

🍳 レシピ / Recipe

<div class="px-2"> <div class="border p-2"> <details> <table> <thead> <tr> <th>A</th> <th>B</th> <th>C</th> <th>weight</th> <th>OUTPUT</th> </tr> <tr> <td><a href="https://civitai.com/models/25694/epicrealism">epicrealism_pureEvolutionV3</a></td> <td><a href="https://civitai.com/models/4384?modelVersionId=94081">dreamshaper_631BakedVae</a></td> <td><a href="https://huggingface.co/runwayml/stable-diffusion-v1-5">v1-5-pruned-emaonly</a></td> <td>Add difference 0.5</td> <td>epicdreamv5</td> </tr> <tr> <td><a href="https://huggingface.co/Ai-tensa/FlexWaifu">FlexWaifuRainbow</a></td> <td><a href="https://civitai.com/models/82813?modelVersionId=106905">sdhk_v40</a></td> <td><a href="https://huggingface.co/runwayml/stable-diffusion-v1-5">v1-5-pruned-emaonly</a></td> <td>Add difference 0.5</td> <td>FlexHKrainbow</td> </tr> <tr> <td>FlexHKrainbow</td> <td>epicdreamv5</td> <td></td> <td>COSAIN</td> <td>FlexHK_Rainbowe_epicdream</td> </tr> <tr> <td>FlexHK_Rainbowe_epicdream</td> <td colspan="3">LoRA <a href="https://huggingface.co/datasets/den2nova/den2niji">den2niji</a>:0.5:KAO,<a href="https://huggingface.co/datasets/den2nova/den2SD">den2SD</a>:0.5:KAO<br>※各LoRAはにじジャーニーと普段使いしてるモデルからの絵柄LoRA SDHKv3.0で学習（データセットとLoRA本体共にリンク先で公開中）<br>※KAOのweight:0,0,0,0,0,0,0,0,1,1,1,1,0,0,0,0,0</td> <td>FlexHK_beta1</td> </tr> <tr> <td><a href="https://civitai.com/models/82813?modelVersionId=89247">sdhk_v30</a></td> <td><a href="https://civitai.com/models/4384?modelVersionId=94081">dreamshaper_631BakedVae</a></td> <td></td> <td>0,1,0.842423804012346,0.71508487654321,0.615234375,0.540123456790123,<br> 0.487003279320988,0.453125,0.435739776234568,0.432098765432099,0.439453125,<br> 0.455054012345679,0.476152584876543,0.5,0.523847415123457,0.544945987654321,0.560546875,<br> 0.2,0.2,0,0.2,0.459876543209876,0.384765625,0.28491512345679,0.157576195987653,0</td> <td>230627_1</td> </tr> <tr> <td>230627_1</td> <td colspan="3">LoRA <a harf="https://huggingface.co/datasets/den2nova/den2niji">den2niji</a>:0.8:KAO,<a href="https://huggingface.co/datasets/den2nova/den2SD">den2SD</a>:0.8:KAO</td> <td>230627_1_LoRA</td> </tr> <tr> <td>230627_1_LoRA</td> <td colspan="3">LoRA den2SD-41:0.3:KAO</td> <td>230627_1_LoRA2</td> </tr> <tr> <td>230627_1_LoRA2</td> <td colspan="3">LoRA <a href="https://civitai.com/models/102188/sdhkv4qu">SDHKv4_QU</a>:2</td> <td>230627_1_LoRA_QU2.0</td> </tr> <tr> <td>FlexHK_beta1</td> <td>230627_1_LoRA_QU2.0</td> <td></td> <td>FAKE_CUBIC_HERMITE</td> <td>FlexHK_beta2</td> </tr> <tr> <td>FlexHK_beta2</td> <td><a href="https://huggingface.co/hakurei/waifu-diffusion-v1-3">wd-v1-3-float16</a></td> <td><a href="https://huggingface.co/runwayml/stable-diffusion-v1-5">v1-5-pruned-emaonly</a></td> <td>Add difference 0.25</td> <td>FlexDreamHK_v1</td> </tr> </tbody> </table> </details> </div> </div>

<details> <summary>🎨 サンプル</summary> <img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/grid-0000.png" width="100%" height="100%"> <pre style="white-space: pre-line;" class="w-full"> 1girl, solo, framed, silver hair, dreadlocks, indigo eyes, huge breasts, china gothic lolita style dress, hand on own chin, sweet, flowers, Bellflower, frozen lakeside , light smile, nice hands, standing Negative prompt: (nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35) Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1658825243, Size: 512x512, Model hash: 7ab6f37bb0, Model: FlexDreamHK_v1, Denoising strength: 0.6, Clip skip: 2, Hires upscale: 2.5, Hires steps: 10, Hires upscaler: Latent, Version: v1.4.0 </pre> <img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/grid-0001.png" width="100%" height="100%"> <pre style="white-space: pre-line;" class="w-full"> 1girl, solo, (wide shot, fisheye:0.85), pink hair, twintails, orange eyes, small breasts, cheerleader pom pom, hand on own knee, rose, instrument, Poinsettia, bedroom , desperation, nice hands, squatting Negative prompt: (nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35) Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2578613301, Size: 512x512, Model hash: 7ab6f37bb0, Model: FlexDreamHK_v1, Denoising strength: 0.6, Clip skip: 2, Hires upscale: 2.5, Hires steps: 10, Hires upscaler: Latent, Version: v1.4.0 </pre> <img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/grid-0002.png" width="100%" height="100%"> <pre style="white-space: pre-line;" class="w-full"> 1girl, solo, from above, red hair, bowl cut, light brown eyes, small breasts, astronaut suit, hand on own head, feeling of floating, space station , surprised, nice hands, flying Negative prompt: (nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35) Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2288316915, Size: 512x512, Model hash: 7ab6f37bb0, Model: FlexDreamHK_v1, Denoising strength: 0.6, Clip skip: 2, Hires upscale: 2.5, Hires steps: 10, Hires upscaler: Latent, Version: v1.4.0 </pre> <img src="https://huggingface.co/den2nova/FlexDreamHK/resolve/main/sample/grid-0003.png" width="100%" height="100%"> <pre style="white-space: pre-line;" class="w-full"> 1girl, solo, album cover, green hair, ponytail hair, dark green eyes, huge breasts, school uniform, arm up, door, prism, building , happy, nice hands, standing, petals, cherry blossoms Negative prompt: (nsfw, extra fingers, deformed hands, polydactyl:1.3), (worst quality, low quality, poor quality, bad quality:1.35) Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1151456510, Size: 512x512, Model hash: 7ab6f37bb0, Model: FlexDreamHK_v1, Denoising strength: 0.6, Clip skip: 2, Hires upscale: 2.5, Hires steps: 10, Hires upscaler: Latent, Version: v1.4.0 </pre> </details>

モデルの作成に際し、ＮＡＩリークフリーマージモデル研究会を大いに活用させて頂きました。<br> 　意欲の持続やアイデアの閃きがあった他、モデル作成に後押しをして下さった方やモデル情報を共有してくださった皆さんに感謝申し上げます。