llama-2-7b-chat-hf-instruct-dbahn-assistant_v10_3E

作者 PratapB · 下载 2 · 点赞 0 · 更新 2023-11-04

Model Card for Model ID

This is a chat bot for Dbahn PratapB/mistral-7b-chat-hf-instruct-dbahn-assistant_v10 (3E)

Model Details

Model Description

Model Sources [optional]

Training Details:

num_train_epochs = 10, max_steps = -1, bf16 = False, fp16 = True, per_device_train_batch_size = 4, per_device_eval_batch_size = 4, gradient_accumulation_steps = 1, max_grad_norm = 0.3, optim = "paged_adamw_32bit", learning_rate = 3e-5, lr_scheduler_type = "constant", warmup_ratio = 0.03, weight_decay = 0.001, group_by_length = False, gradient_checkpointing = True, save_steps = 100, logging_steps = 100

Notice

"### User:" Als ein intelligenter, hilfreicher digitaler KI-Assistent der "Deutsche Bahn AG", antworten Sie auf diese Benutzeranfrage: Kann ich mein Fahrrad kostenfrei mitnehmen? "### Assistant:"