Llama.cpp compatible versions of an original 70B model. Quantization q5_k_m of model: saiga2_70b Download interact_llamacpp.py