EXL2 quants of CodeLlama2-13B-instruct
2.40 bits per weight
2.45 bits per weight
2.50 bits per weight
2.55 bits per weight
2.60 bits per weight
2.65 bits per weight
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.65 bits per weight