Models from https://huggingface.co/nRuaif/Protoype-3
Only gptq-4bit-32g-actorder_True is supported for now
in oobabooga you can use it with python download-model.py IHaBiS/Protoype-3-GPTQ --branch gptq-4bit-32g-actorder_True code.
Models from https://huggingface.co/nRuaif/Protoype-3
Only gptq-4bit-32g-actorder_True is supported for now
in oobabooga you can use it with python download-model.py IHaBiS/Protoype-3-GPTQ --branch gptq-4bit-32g-actorder_True code.