LLaMa_V2-13B-Instruct-Uncensored-GGML

作者 CONCISE · 下载 1 · 点赞 4 · 更新 2023-11-03

quantized Uncensored LLama2 Instruct uncensored

LLaMa_V2-13B-Instruct-Uncensored-GGML

Quantized LLaMa.V2 13B model weights - Instruction based

Big thank you to Eric Hartford for his work aiding the creation of datasets such as:
- wizardlm_evol_instruct_V2_196k_unfiltered_merged_split
- wizard_vicuna_70k_unfiltered

Such datasets play a big role in accurately addressing model biases, without sacrificing performance

Provided Files:

Quantised:

LLaMa_V2-13B-Instruct-Uncensored-q4_0-GGML.bin

LLaMa_V2-13B-Instruct-Uncensored-q4_1-GGML.bin

LLaMa_V2-13B-Instruct-Uncensored-q5_0-GGML.bin

Unquantised:

LLaMa_V2-13B-Instruct-Uncensored-f16-Unquantized-GGML.bin