Merge of oh-yeontaek/llama-2-13B-LoRA-assemble and oh-yeontaek/llama-2-13B-LoRA-assemble using ties merge. (It is weird, it was a mistake but the score is 0.01 point better)
Weights
Density
Evulation Results (Open LLM Leaderboard)
| Metric | Value |
|---|---|
| Avg. | 65.72 |
| ARC (25-shot) | 63.65 |
| HellaSwag (10-shot) | 83.47 |
| MMLU (5-shot) | 59.82 |
| TruthfulQA (0-shot) | 55.94 |