EXL2 quants of OpenLlama-3B

2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.65 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json