Llama.cpp compatible version of an original 30B model.

• Download ggml-model-q4_1.bin.
• Download interact_llamacpp.py

How to run:

sudo apt-get install git-lfs
pip install llama-cpp-python fire

python3 interact_llamacpp.py ggml-model-q4_1.bin

System requirements:

• 32GB RAM
• CPU with 4 cores