WizardLM 30B v1.0 GPTQ
From: https://huggingface.co/WizardLM/WizardLM-30B-V1.0
Model
- wizardlm-30b-1.0-4bit.safetensors
- Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
- Works with AutoGPTQ
- Parameters: Groupsize = None. --act-order.