120-Days-of-LORA-v2-13B

作者 zattio770 · 下载 0 · 点赞 4 · 更新 2023-11-03

not-for-all-audiences art nsfw conversational chat llama2-2-13B

Model Description

A LORA trained on the book 120 Days of Sodom. It Is intended for heavy NSFW content. Many users might find it disturbing.

Uses

Direct Use

This model is finetuned for heavy NSFW roleplay, while can still an assistant. (Might not be very helpfull)

Out-of-Scope Use

Be safe, I am not responsible for what this lora outputs. Do anything you want. I don't care

Bias, Risks, and Limitations

Model might have bias to NSFW due to the large % of NSFW data in the training set.

Training Details

Training Data

raw text The 120 Days of Sodom by Marquis de Sade(1904)

Training Procedure

4bit MythoMaxL2 Rank: 128 Alpha: 256 Batch size: 128 Micro Batch: 1 Cutoff: 256 Epoch: 3 Learning Rate: 3e-4

Overlap Length: 64 Prefer Newline: 128

Training Hyperparameters

Compute Infrastructure

Hardware Type: 3080Ti Hours used: 10 OogaBooga