license: cc-by-nc-4.0

<p align="center"> <img width="500px" alt="Project Baize" src="https://user-images.githubusercontent.com/22514219/229195563-0cddfa74-e52f-4413-b4b4-e4ba489c4b3d.png"> </p> <hr>

What's Baize?

Baize is an open-source chat model fine-tuned with LoRA. It uses 100k dialogs generated by letting ChatGPT chat with itself. This repo contains 7B model related health topic.

Why it's called Baize?

Baize (白泽) is a mythical creature in Chinese folklore, who speaks human languages and knows everything. This is exactly what we expect from a chat model.

Training Parameters

• Base Model: LLaMA-7B
• Training Epoch: 1
• Batch Size: 64
• Maximum Input Length: 512
• Learning Rate: 2e-4
• LoRA Rank: 8
• Updated Modules: All Linears

Training Dataset

• Quora Dialogs (54,456):
• Medical Dialogs (46,867)

More details can be found in the Baize GitHub