StableVicuna 13B 4-bit
From CarperAI: https://huggingface.co/CarperAI/stable-vicuna-13b-delta
Folders
ggml: q4_0 and q4_1
gptq: works with Triton and CUDA branches
From CarperAI: https://huggingface.co/CarperAI/stable-vicuna-13b-delta
ggml: q4_0 and q4_1
gptq: works with Triton and CUDA branches