ExllamaV2 version of the model created by IkariDev
Original Model https://huggingface.co/IkariDev/Athnete-13B
Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.
Main is 8bpw
4b8h is 4bpw
Athnete model. Use Alpaca format. Suitable for RP, ERP and general stuff.
Despite the awful banner i made, this model could actually be better than raw Athena v3.
<!-- description start -->
Description
<!-- Recommended settings - contributed by localfultonextractor -->
This repo contains fp16 files of Athnete.
<!-- GGUF - By TheBloke -->
<!-- GPTQ - By TheBloke -->
<!-- exl2 - by AzureBlack -->
<!-- AWQ - By TheBloke -->
GGUF - by IkariDev <!-- OLD(GGUF - by IkariDev+Undi95) -->
Ratings:
Note: I have permission of all users to upload their ratings, i DONT screenshot random reviews without asking if i can put them here!
<!-- description end --> <!-- description start -->
Models and loras used
- IkariDev/Athena-v3
- Undi95/Nete-13B <!-- description end --> <!-- prompt-template start -->
Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
HUGE thanks to Undi95 for doing the merging (Recipe was my idea, he merged)