Wizard Vicuna 7B Uncensored GPTQ

From: https://huggingface.co/ehartford/Wizard-Vicuna-7B-Uncensored

Model

• Wizard-Vicuna-7B-Uncensored-GPTQ-4bit-128g.compat.no-act-order.safetensors
  • Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
  • Works with AutoGPTQ.
  • Parameters: Groupsize = 128g. No act-order.