13B-Ouroboros-GPTQ4bit-128g-CUDA

作者 CalderaAI · 下载 11 · 点赞 0 · 更新 2023-11-03

llama alpaca vicuna uncensored merge mix airoboros openorca orcamini orca instruct mixtune GPTQ quantized 4bit cuda

GPTQ 4 bit 128 groupsize CUDA quantization of CalderaAI's 13B Ouroboros:

https://huggingface.co/CalderaAI/13B-Ouroboros