Mistral-11B-OpenOrcaPlatypus

This is the model for Mistral-11B-OpenOrcaPlatypus. I used mergekit to reproduce one of Undi95's secret sauces

Yaml Config

slices:
  - sources:
    - model: Open-Orca/Mistral-7B-OpenOrca
      layer_range: [0, 24]
  - sources:
    - model: akjindal53244/Mistral-7B-v0.1-Open-Platypus
      layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16