This model was quantized with AWQ algorithm. Intended to use with lmdeploy package.