Synthia-13B EXL2
Weights of Synthia-13B converted to EXL2 format.
Each separate quant is in a different branch, like in The Bloke's GPTQ repos.
export BRANCH=6_0-bpw-h6
git clone --single-branch --branch ${BRANCH} https://huggingface.co/latimar/Synthia-13B-exl2
There are the following branches:
4_625-bpw-h6
6_0-bpw-h6