<a href="https://www.buymeacoffee.com/PulsarAI" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
Info
This model is an adapter model trained with QloRA technique.
- 📜 Model license: Llama 2 Community License Agreement
- 🏛️ Base Model: Llama-2-70b-hf
- 🖥️ Machine: Nvidia A100 (40 GB vRAM)
- 💵 Cost: $3.5
- ⌛ Training Time: 3 hour 22 minutes
- 📊 Dataset Used: vicgalle/alpaca-gpt4
You can acces Llama-2 paper by clicking here
Evulation Results (Open LLM Leaderboard)
| Average | ARC (25-shot) | HellaSwag (10-shot) | MMLU (5-shot) | TruthfulQA (0-shot) | |
|---|---|---|---|---|---|
| Scores | 67.3 | 66.38 | 84.51 | 62.75 | 55.57 |
Loss Graph
