llama-30b-awq-w4

作者 Sherstnev · 下载 0 · 点赞 0 · 更新 2023-11-03

This model was quantized with AWQ algorithm. Intended to use with lmdeploy package.