Quantized bloomz-3b using peft(lora) <br> 4 bit quant is used <br> GPU will be needed to use this model