CodeBooga-34B-v0.1-EXL2-4.250b

A quantized version of CodeBooga-34B-v0.1 in EXL2 format.

It was created with WizardLM_evol_instruct_70k as the parquet calibration file: 0000.parquet.

Credits to Reddit user kpodkanowicz for the idea of using this dataset for calibration instead of wikitext:

https://www.reddit.com/r/Oobabooga/comments/178yqmg/gptq_vs_exl2_vs_awq_vs_q4_k_m_model_sizes/k55orkw/?context=3

<a href="https://ko-fi.com/oobabooga"><img src="https://i.imgur.com/UJlEAYw.png"></a>