llama-2-7b-8bit-nested

作者 TransformerTales · 下载 0 · 点赞 2 · 更新 2023-11-03

I used Google Colab to quantize/nest the Llama 2 7B model. Should help out those who wish to use Llama 2 7B on a low-end computer. GPU is still recomended...