<div align="center"> <img src="https://github.com/InternLM/lmdeploy/assets/36994684/0cf8d00f-e86b-40ba-9b54-dc8f1bc6c8d8" width="600"/>

Generic badge

</div>

Model

Llama-2-7b-qlora-msagent-react is fine-tuned from Llama-2-7b with MSAgent-Bench dataset by XTuner.

Quickstart

Usage with XTuner CLI

Installation

pip install xtuner

Chat

xtuner chat meta-llama/Llama-2-7b-hf --adapter xtuner/Llama-2-7b-qlora-msagent-react --lagent

Fine-tune

Use the following command to quickly reproduce the fine-tuning results.

NPROC_PER_NODE=8 xtuner train llama2_7b_qlora_msagent_react_e3_gpu8