This is simply a sharded version of the Mistral 7B so that each layer is it's own shard.