Marcoroni-70B-v1-4.65bpw-h6-exl2

作者 Panchovix · 下载 0 · 点赞 0 · 更新 2023-11-04

4.65 bit/bpw quantization of Marcoroni-70B-v1 (https://huggingface.co/AIDC-ai-business/Marcoroni-70B-v1) using exllamav2.