saiga_13b_ggml

作者 IlyaGusev · 下载 0 · 点赞 15 · 更新 2023-11-02

Llama.cpp compatible versions of an original 13B model.

How to run:

sudo apt-get install git-lfs
pip install llama-cpp-python fire

python3 interact_llamacpp.py ggml-model-q4_1.bin

System requirements: