huggyllama/llama-30b merged with serpdotai/llama-oasst-lora-30B, quantized to 4bit. 16bit and groupsize versions are on my repo as well.
huggyllama/llama-30b merged with serpdotai/llama-oasst-lora-30B, quantized to 4bit. 16bit and groupsize versions are on my repo as well.