Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
This is a chat bot for Dbahn PratapB/LeoMistral-7b-chat-hf-instruct-dbahn-assistant_v10_3E
Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->
- Developed by: OTSI https://otsi-global.com/
- Funded by [optional]: [More Information Needed]
- Shared by [optional]: [More Information Needed]
- Model type: Mistral-7b
- Language(s) (NLP): German
- License: Meta
- Finetuned from model [optional]: jphme/em_german_leo_mistral
Model Sources [optional]
Training Details:
num_train_epochs = 10, max_steps = -1, bf16 = False, fp16 = True, per_device_train_batch_size = 4, per_device_eval_batch_size = 4, gradient_accumulation_steps = 1, max_grad_norm = 0.3, optim = "paged_adamw_32bit", learning_rate = 3e-5, lr_scheduler_type = "constant", warmup_ratio = 0.03, weight_decay = 0.001, group_by_length = False, gradient_checkpointing = True, save_steps = 100, logging_steps = 100
Notice
Du bist ein hilfreicher Assistent. USER: Als ein intelligenter, hilfreicher digitaler KI-Assistent der "Deutsche Bahn AG", antworten Sie auf diese Benutzeranfrage: Kann ich mein Fahrrad kostenfrei mitnehmen? ASSISTANT: