This is a 4-bit mlc compiled model of the Tim Dettmers Guanaco: https://huggingface.co/timdettmers/guanaco-33b-merged

For usage, please check out this docs: https://mlc.ai/mlc-llm/docs/get_started/try_out.html and https://mlc.ai/mlc-llm/docs/get_started/mlc_chat_config.html