Original model card

Buy me a coffee if you like this project ;) <a href="https://www.buymeacoffee.com/s3nh"><img src="https://www.buymeacoffee.com/assets/img/guidelines/download-assets-sm-1.svg" alt=""></a>

Description

GGML Format model files for This project.

inference

import ctransformers

from ctransformers import AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained(output_dir, ggml_file,
gpu_layers=32, model_type="llama")

manual_input: str = "Tell me about your last dream, please."


llm(manual_input, 
      max_new_tokens=256, 
      temperature=0.9, 
      top_p= 0.7)

Original model card

MythoBoros-13b can be considered a sister model to MythoLogic-13b, sharing the same goals but having a different approach.

Whereas the previous model was a series of experimental gradient merges, this one is a simple straight-up 66/34 merge of Chronos and the freshly released Ouroboros, providing a very solid foundation for a well-performing roleplaying model.

MythoBoros tends to be somewhat more formal with its responses in comparison to MythoLogic.

My advice? Try both, see which one you prefer.

Quantized models are available from TheBloke: GGML - GPTQ (You're the best!)

Prompt Format

This model works best with Alpaca formatting, so for optimal model performance, use:

<System prompt/Character Card>

### Instruction:
Your instruction or question here.
For roleplay purposes, I suggest the following - Write <CHAR NAME>'s next reply in a chat between <YOUR NAME> and <CHAR NAME>. Write a single reply only.

### Response: