13B-HyperMantis_GPTQ_4bit-128g

作者 digitous · 下载 131 · 点赞 12 · 更新 2023-11-02

llama alpaca mix gptq quant

GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis