roberta-base

This model is a fine-tuned model that was trained using Amazon SageMaker and the new Hugging Face Deep Learning container.

• Problem type: Multi Class Text Classification (emotion detection).

It achieves the following results on the evaluation set:

• Loss: 0.1613253802061081
• f1: 0.9413321705151999

Hyperparameters

{
    "epochs": 10,
    "train_batch_size": 16,
    "learning_rate": 3e-5, 
    "weight_decay":0.01,
    "load_best_model_at_end": true,
    "model_name":"roberta-base",
    "do_eval": True,
    "load_best_model_at_end":True
}

Validation Metrics