Llama.cpp compatible versions of an original 70B model.

• Download one of the versions, for example ggml-model-q4_1.gguf.
• Download interact_llamacpp.py

How to run:

sudo apt-get install git-lfs
pip install llama-cpp-python fire

python3 interact_llamacpp.py ggml-model-q4_1.gguf

System requirements:

• 45GB RAM for q4_1