ExllamaV2 version of the model created by IkariDev

Original Model https://huggingface.co/IkariDev/Athnete-13B

Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.

Main is 8bpw

4b8h is 4bpw


image/png

Athnete model. Use Alpaca format. Suitable for RP, ERP and general stuff.

Despite the awful banner i made, this model could actually be better than raw Athena v3.

<!-- description start -->

Description

<!-- Recommended settings - contributed by localfultonextractor -->

This repo contains fp16 files of Athnete.

<!-- GGUF - By TheBloke -->

<!-- GPTQ - By TheBloke -->

<!-- exl2 - by AzureBlack -->

<!-- AWQ - By TheBloke -->

fp16 - by IkariDev

GGUF - by IkariDev <!-- OLD(GGUF - by IkariDev+Undi95) -->

Ratings:

Note: I have permission of all users to upload their ratings, i DONT screenshot random reviews without asking if i can put them here!

<!-- description end --> <!-- description start -->

Models and loras used

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

HUGE thanks to Undi95 for doing the merging (Recipe was my idea, he merged)