Pretrained checkpoint: facebook/bart-large-mnli
Traning hyperparameters:
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 24
- eval_batch_size: 24
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3
Training results
| Epoch | Train loss | Subtask 3 f1 | Subtask 3 precision | Subtask 3 recall | Subtask4 accuracy |
|---|---|---|---|---|---|
| 1 | 317.0372867549886 | 0.9007858546168959 | 0.9070227497527201 | 0.8946341463414634 | 0.8673170731707317 |
| 2 | 133.277006254546 | 0.9203364670954973 | 0.9337349397590361 | 0.9073170731707317 | 0.8741463414634146 |
| 3 | 49.748294037497544 | 0.9251968503937008 | 0.9334657398212513 | 0.9170731707317074 | 0.8887804878048781 |
