<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
bart-base-paraphrasing
This model is a fine-tuned version of facebook/bart-base on the None dataset. It achieves the following results on the evaluation set:
- Loss: 0.033200
- Rouge1: 52.885700
- Rouge2: 47.674400
- Rougel: 50.037000
- Rougelsum: 52.002300
- Gen Len: 20.0
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 4e-05
- train_batch_size: 10
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20
Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 1.500200 | 1 | 10 | 0.540744 | 51.494300 | 46.396200 | 48.464600 | 50.692800 | 19.330000 |
| 0.772100 | 1 | 20 | 0.460911 | 52.542000 | 47.657200 | 49.091900 | 51.860400 | 19.820000 |
| 0.653500 | 1 | 30 | 0.462111 | 51.457500 | 45.802000 | 48.439500 | 50.641100 | 19.830000 |
| 0.657400 | 1 | 40 | 0.410792 | 53.428800 | 48.033700 | 49.830500 | 52.563600 | 19.920000 |
| 0.637300 | 1 | 50 | 0.417746 | 52.422300 | 47.417400 | 49.360900 | 51.637900 | 19.600000 |
| 0.464800 | 2 | 60 | 0.412119 | 54.257400 | 49.465400 | 52.024500 | 53.416800 | 19.780000 |
| 0.484500 | 2 | 70 | 0.392577 | 53.640400 | 48.611300 | 50.708300 | 52.798100 | 19.810000 |
| 0.384000 | 2 | 80 | 0.405939 | 53.321900 | 48.479400 | 51.057200 | 52.514900 | 19.860000 |
| 0.424000 | 2 | 90 | 0.409505 | 53.460000 | 48.560600 | 50.364500 | 52.653400 | 19.860000 |
| 0.529600 | 2 | 100 | 0.376642 | 53.498400 | 48.590500 | 51.347100 | 52.754700 | 19.820000 |
| 0.337300 | 3 | 110 | 0.386621 | 54.007900 | 49.246700 | 51.821500 | 53.104500 | 19.730000 |
| 0.354700 | 3 | 120 | 0.407476 | 53.641200 | 48.705100 | 50.964800 | 52.986400 | 19.920000 |
| 0.348700 | 3 | 130 | 0.385953 | 52.932300 | 47.667500 | 49.992800 | 52.144400 | 19.800000 |
| 0.369800 | 3 | 140 | 0.388468 | 53.839000 | 48.703600 | 50.928600 | 52.916900 | 19.950000 |
| 0.361100 | 3 | 150 | 0.393050 | 53.532900 | 48.849700 | 50.780800 | 52.818500 | 19.900000 |
| 0.264600 | 4 | 160 | 0.397602 | 52.870500 | 47.965400 | 50.141900 | 52.249800 | 19.720000 |
| 0.247000 | 4 | 170 | 0.428163 | 53.854300 | 48.954700 | 50.877200 | 53.073600 | 19.830000 |
| 0.313800 | 4 | 180 | 0.412245 | 53.352000 | 48.384300 | 50.859600 | 52.413400 | 19.930000 |
| 0.265100 | 4 | 190 | 0.425944 | 54.151600 | 49.344000 | 51.995500 | 53.433600 | 19.920000 |
| 0.280900 | 4 | 200 | 0.407293 | 54.266300 | 49.390600 | 51.916800 | 53.408000 | 19.920000 |
| 0.199500 | 5 | 210 | 0.432796 | 52.924400 | 47.881800 | 50.328700 | 52.048600 | 19.930000 |
| 0.222100 | 5 | 220 | 0.451023 | 53.211500 | 47.724400 | 50.356100 | 52.387600 | 19.920000 |
| 0.198000 | 5 | 230 | 0.462028 | 53.640100 | 48.316100 | 50.512400 | 52.809000 | 19.920000 |
| 0.239500 | 5 | 240 | 0.425439 | 52.813300 | 47.191400 | 49.461500 | 52.011200 | 19.900000 |
| 0.194800 | 5 | 250 | 0.410010 | 54.508800 | 49.426500 | 51.134300 | 53.692300 | 19.810000 |
| 0.151900 | 6 | 260 | 0.444454 | 52.762000 | 47.518500 | 49.889300 | 51.962300 | 19.770000 |
| 0.198200 | 6 | 270 | 0.456969 | 53.568900 | 48.212300 | 50.662400 | 52.725800 | 19.930000 |
| 0.171500 | 6 | 280 | 0.462446 | 52.807200 | 47.721900 | 50.285800 | 52.111600 | 19.880000 |
| 0.208600 | 6 | 290 | 0.428070 | 53.782100 | 48.542300 | 51.090800 | 53.021800 | 19.890000 |
| 0.158600 | 6 | 300 | 0.461858 | 54.069500 | 49.227100 | 51.325300 | 53.310600 | 19.900000 |
| 0.139700 | 7 | 310 | 0.476241 | 52.988600 | 48.009200 | 50.622300 | 52.195300 | 19.700000 |
| 0.135900 | 7 | 320 | 0.507567 | 55.107400 | 50.664700 | 53.052400 | 54.412700 | 19.920000 |
| 0.153300 | 7 | 330 | 0.475348 | 53.977700 | 49.112500 | 51.732400 | 53.268500 | 19.920000 |
| 0.123100 | 7 | 340 | 0.462978 | 52.836700 | 47.669800 | 50.055900 | 51.986000 | 19.750000 |
| 0.166000 | 7 | 350 | 0.462223 | 53.250900 | 48.223500 | 50.890800 | 52.371700 | 19.670000 |
| 0.104200 | 8 | 360 | 0.471708 | 53.446800 | 48.321900 | 51.074000 | 52.582200 | 19.860000 |
| 0.094200 | 8 | 370 | 0.513058 | 53.509900 | 48.640100 | 51.348000 | 52.703300 | 19.920000 |
| 0.108000 | 8 | 380 | 0.488812 | 53.939900 | 48.989500 | 51.469100 | 53.092300 | 19.920000 |
| 0.396000 | 8 | 390 | 0.483152 | 52.146500 | 46.819100 | 49.638500 | 51.317300 | 19.790000 |
| 0.316700 | 8 | 400 | 0.505258 | 52.444500 | 47.065700 | 49.912300 | 51.540900 | 19.930000 |
| 0.092600 | 9 | 410 | 0.491664 | 53.938100 | 49.100200 | 51.639300 | 53.070000 | 19.910000 |
| 0.114300 | 9 | 420 | 0.484384 | 51.931900 | 46.400500 | 49.538200 | 51.004200 | 19.860000 |
| 0.085200 | 9 | 430 | 0.523603 | 53.075300 | 47.999000 | 50.806600 | 52.153500 | 19.890000 |
| 0.089400 | 9 | 440 | 0.529681 | 52.352800 | 47.057300 | 49.917100 | 51.417500 | 19.830000 |
| 0.092000 | 9 | 450 | 0.545310 | 52.940200 | 47.693700 | 50.416700 | 52.080700 | 19.790000 |
| 0.083700 | 10 | 460 | 0.553549 | 53.268800 | 48.339100 | 50.894300 | 52.501200 | 19.920000 |
| 0.075300 | 10 | 470 | 0.524759 | 53.187800 | 47.921500 | 50.284400 | 52.072000 | 19.880000 |
| 0.086100 | 10 | 480 | 0.542759 | 53.410300 | 48.170500 | 49.919500 | 52.334600 | 19.870000 |
| 0.086800 | 10 | 490 | 0.550681 | 52.917700 | 47.322200 | 49.576600 | 51.941500 | 19.880000 |
| 0.095600 | 10 | 500 | 0.550618 | 53.855400 | 48.679200 | 51.050700 | 53.063300 | 19.840000 |
| 0.063000 | 11 | 510 | 0.582389 | 53.384000 | 48.007900 | 50.821200 | 52.415500 | 19.920000 |
| 0.072000 | 11 | 520 | 0.563888 | 53.186800 | 48.050900 | 50.699900 | 52.317700 | 19.810000 |
| 0.075300 | 11 | 530 | 0.584735 | 53.975400 | 48.787500 | 50.590800 | 53.049900 | 19.900000 |
| 0.083200 | 11 | 540 | 0.556683 | 52.261700 | 46.765000 | 48.966100 | 51.240600 | 19.910000 |
| 0.084800 | 11 | 550 | 0.531437 | 53.107700 | 47.959100 | 50.294100 | 52.144400 | 19.890000 |
| 0.059000 | 12 | 560 | 0.548251 | 54.056300 | 49.014100 | 50.701700 | 53.087700 | 19.880000 |
| 0.072000 | 12 | 570 | 0.552766 | 53.755500 | 48.601300 | 50.022600 | 52.684300 | 19.900000 |
| 0.053700 | 12 | 580 | 0.571895 | 53.344600 | 48.156000 | 50.539100 | 52.473000 | 19.930000 |
| 0.064000 | 12 | 590 | 0.556930 | 53.790300 | 48.777600 | 50.648800 | 52.865700 | 19.900000 |
| 0.051100 | 12 | 600 | 0.566761 | 53.251500 | 48.205000 | 49.942500 | 52.302000 | 19.930000 |
| 0.032700 | 13 | 610 | 0.606187 | 52.956600 | 47.573000 | 49.586600 | 51.893600 | 19.960000 |
| 0.066000 | 13 | 620 | 0.592303 | 52.862200 | 47.470600 | 49.631400 | 51.833400 | 19.960000 |
| 0.050800 | 13 | 630 | 0.572726 | 53.060700 | 47.741300 | 50.195900 | 52.158500 | 19.930000 |
| 0.055100 | 13 | 640 | 0.579977 | 52.551000 | 47.204300 | 49.678900 | 51.588600 | 19.930000 |
| 0.039300 | 13 | 650 | 0.594248 | 52.505600 | 47.256800 | 49.814200 | 51.673600 | 19.890000 |
| 0.047200 | 14 | 660 | 0.596428 | 53.929900 | 49.264900 | 51.170500 | 53.304600 | 19.840000 |
| 0.048400 | 14 | 670 | 0.602180 | 52.710700 | 47.515200 | 50.447400 | 51.889100 | 19.930000 |
| 0.049300 | 14 | 680 | 0.589604 | 52.581000 | 47.250300 | 49.835200 | 51.752900 | 19.930000 |
| 0.037300 | 14 | 690 | 0.595846 | 53.748100 | 48.891500 | 50.913300 | 52.880500 | 19.900000 |
| 0.043900 | 14 | 700 | 0.590349 | 52.559200 | 47.492300 | 50.202500 | 51.754500 | 19.950000 |
| 0.049500 | 15 | 710 | 0.607460 | 53.145900 | 48.229600 | 50.833100 | 52.304700 | 19.960000 |
| 0.048800 | 15 | 720 | 0.602753 | 53.174300 | 48.162100 | 50.561600 | 52.294000 | 19.960000 |
| 0.042800 | 15 | 730 | 0.625110 | 53.669800 | 48.914600 | 51.321100 | 52.821900 | 19.920000 |
| 0.033200 | 15 | 740 | 0.589171 | 53.363200 | 48.281000 | 50.815500 | 52.441000 | 19.880000 |
| 0.044300 | 15 | 750 | 0.611709 | 53.340500 | 48.307100 | 50.490500 | 52.533600 | 19.920000 |
| 0.053300 | 16 | 760 | 0.596733 | 53.249800 | 48.258300 | 50.527100 | 52.431700 | 19.880000 |
| 0.031200 | 16 | 770 | 0.611742 | 52.944500 | 47.696800 | 50.040200 | 52.053000 | 19.930000 |
| 0.036300 | 16 | 780 | 0.626590 | 52.682600 | 47.331800 | 50.056500 | 51.711700 | 19.930000 |
| 0.035000 | 16 | 790 | 0.608956 | 52.703500 | 47.373300 | 49.867900 | 51.849900 | 19.930000 |
| 0.040500 | 16 | 800 | 0.609984 | 52.378100 | 46.979400 | 49.478100 | 51.493900 | 19.930000 |
| 0.037800 | 17 | 810 | 0.610033 | 53.232500 | 48.241600 | 49.812300 | 52.417200 | 19.950000 |
| 0.032200 | 17 | 820 | 0.616732 | 53.148700 | 48.271200 | 49.913400 | 52.423200 | 19.950000 |
| 0.027400 | 17 | 830 | 0.625509 | 53.140300 | 48.066100 | 50.356100 | 52.293400 | 19.930000 |
| 0.027700 | 17 | 840 | 0.632047 | 53.140300 | 48.066100 | 50.356100 | 52.293400 | 19.930000 |
| 0.030200 | 17 | 850 | 0.634628 | 53.001900 | 47.875800 | 50.176700 | 52.088800 | 19.930000 |
| 0.034400 | 18 | 860 | 0.634640 | 53.013500 | 48.024900 | 49.977000 | 52.129700 | 19.910000 |
| 0.033100 | 18 | 870 | 0.633774 | 53.218100 | 48.172300 | 50.448700 | 52.417500 | 19.930000 |
| 0.034400 | 18 | 880 | 0.616925 | 53.272600 | 48.223800 | 50.509400 | 52.461700 | 19.930000 |
| 0.040000 | 18 | 890 | 0.614516 | 52.943800 | 47.929600 | 50.220200 | 52.148500 | 19.890000 |
| 0.029100 | 18 | 900 | 0.619765 | 52.965400 | 47.957200 | 50.229600 | 52.205700 | 19.910000 |
| 0.025800 | 19 | 910 | 0.626218 | 52.907700 | 47.760600 | 50.164100 | 52.126000 | 19.950000 |
| 0.037400 | 19 | 920 | 0.621437 | 52.937400 | 47.904700 | 50.532300 | 52.200300 | 19.930000 |
| 0.023600 | 19 | 930 | 0.622434 | 52.937400 | 47.930800 | 50.252200 | 52.200300 | 19.930000 |
| 0.016100 | 19 | 940 | 0.614024 | 52.901900 | 47.918400 | 50.491200 | 52.133900 | 19.930000 |
| 0.041100 | 19 | 950 | 0.617579 | 53.034500 | 48.026800 | 50.307200 | 52.233700 | 19.950000 |
| 0.025500 | 20 | 960 | 0.620153 | 53.018900 | 47.885800 | 50.222300 | 52.115400 | 19.950000 |
| 0.024000 | 20 | 970 | 0.619979 | 53.018900 | 47.885800 | 50.222300 | 52.115400 | 19.950000 |
| 0.029500 | 20 | 980 | 0.618171 | 53.018900 | 47.885800 | 50.222300 | 52.115400 | 19.950000 |
| 0.012900 | 20 | 990 | 0.619486 | 53.027300 | 47.891900 | 50.229900 | 52.122700 | 19.950000 |
| 0.033200 | 20 | 1000 | 0.620059 | 52.885700 | 47.674400 | 50.037000 | 52.002300 | 19.950000 |
