<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
bart-base-paraphrasing
This model is a fine-tuned version of facebook/bart-base on the None dataset. It achieves the following results on the evaluation set:
- Loss: 0.135500
- Rouge1: 32.399800
- Rouge2: 25.275900
- Rougel: 30.322200
- Rougelsum: 31.459500
- Gen Len: 20.0
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 4e-05
- train_batch_size: 16
- eval_batch_size: 20
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 10
Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 1.110900 | 1 | 20 | 0.649241 | 31.050300 | 23.973300 | 28.952200 | 30.114800 | 19.965200 |
| 0.707200 | 1 | 40 | 0.604967 | 30.421600 | 22.941900 | 28.194500 | 29.408600 | 19.998300 |
| 0.645800 | 1 | 60 | 0.577806 | 31.129700 | 24.142600 | 29.114900 | 30.237500 | 20.000000 |
| 0.657500 | 1 | 80 | 0.542420 | 31.140900 | 24.045000 | 29.186100 | 30.225700 | 19.998300 |
| 0.610200 | 1 | 100 | 0.555390 | 31.324400 | 24.399300 | 29.340700 | 30.487900 | 20.000000 |
| 0.612400 | 1 | 120 | 0.533283 | 31.907300 | 25.085300 | 29.983400 | 31.090100 | 20.000000 |
| 0.558100 | 1 | 140 | 0.503850 | 31.137500 | 24.259700 | 29.174700 | 30.297800 | 20.000000 |
| 0.617000 | 1 | 160 | 0.512676 | 31.575500 | 24.508400 | 29.472900 | 30.697700 | 20.000000 |
| 0.572100 | 1 | 180 | 0.470928 | 31.757700 | 24.963600 | 29.798800 | 30.949300 | 20.000000 |
| 0.563600 | 1 | 200 | 0.477484 | 31.277800 | 24.694900 | 29.496900 | 30.546500 | 19.998300 |
| 0.549000 | 1 | 220 | 0.464705 | 31.547900 | 24.783700 | 29.620100 | 30.717600 | 20.000000 |
| 0.545100 | 1 | 240 | 0.456029 | 31.406500 | 24.418500 | 29.394600 | 30.539200 | 20.000000 |
| 0.498000 | 1 | 260 | 0.420587 | 31.747000 | 24.919900 | 29.789400 | 30.891900 | 20.000000 |
| 0.497900 | 1 | 280 | 0.437126 | 31.403000 | 24.407800 | 29.435800 | 30.529800 | 20.000000 |
| 0.466600 | 2 | 300 | 0.416397 | 32.079200 | 25.387500 | 30.220300 | 31.262000 | 20.000000 |
| 0.446200 | 2 | 320 | 0.419514 | 32.079500 | 25.261900 | 30.184600 | 31.261500 | 20.000000 |
| 0.406300 | 2 | 340 | 0.417019 | 31.950400 | 25.306400 | 30.126200 | 31.165600 | 20.000000 |
| 0.411200 | 2 | 360 | 0.410052 | 32.384900 | 25.795600 | 30.624500 | 31.649300 | 20.000000 |
| 0.437800 | 2 | 380 | 0.412937 | 31.739100 | 24.850800 | 29.862100 | 30.982400 | 20.000000 |
| 0.419600 | 2 | 400 | 0.406854 | 31.489600 | 24.432500 | 29.517200 | 30.632900 | 20.000000 |
| 0.408400 | 2 | 420 | 0.404026 | 31.642200 | 24.846900 | 29.716100 | 30.829100 | 20.000000 |
| 0.438100 | 2 | 440 | 0.398692 | 31.769900 | 25.074000 | 29.930400 | 31.024500 | 20.000000 |
| 0.401300 | 2 | 460 | 0.400428 | 31.429500 | 24.790800 | 29.548700 | 30.704200 | 20.000000 |
| 0.395300 | 2 | 480 | 0.397955 | 31.831100 | 24.881600 | 29.782700 | 30.952200 | 20.000000 |
| 0.395500 | 2 | 500 | 0.400316 | 31.816000 | 25.031100 | 29.938200 | 31.070800 | 20.000000 |
| 0.427800 | 2 | 520 | 0.398385 | 32.100200 | 25.320300 | 30.257200 | 31.350800 | 20.000000 |
| 0.400900 | 2 | 540 | 0.397272 | 31.768100 | 24.850100 | 29.710100 | 30.932100 | 20.000000 |
| 0.427600 | 2 | 560 | 0.392695 | 31.930100 | 25.084900 | 29.957200 | 31.102900 | 20.000000 |
| 0.387900 | 3 | 580 | 0.399037 | 31.813900 | 24.913500 | 29.798900 | 31.021000 | 20.000000 |
| 0.323500 | 3 | 600 | 0.389272 | 31.992600 | 25.169800 | 30.063600 | 31.153100 | 19.995700 |
| 0.317300 | 3 | 620 | 0.386492 | 31.992100 | 25.154700 | 30.066900 | 31.195300 | 20.000000 |
| 0.330400 | 3 | 640 | 0.402186 | 31.302900 | 24.220400 | 29.340700 | 30.436700 | 20.000000 |
| 0.356700 | 3 | 660 | 0.389047 | 32.074300 | 25.118600 | 30.137500 | 31.212800 | 20.000000 |
| 0.338600 | 3 | 680 | 0.401531 | 31.940100 | 25.027400 | 29.987200 | 31.038700 | 20.000000 |
| 0.356700 | 3 | 700 | 0.376122 | 32.045000 | 25.249500 | 30.061100 | 31.190300 | 20.000000 |
| 0.344300 | 3 | 720 | 0.397580 | 32.053800 | 25.201600 | 30.177200 | 31.191000 | 20.000000 |
| 0.369000 | 3 | 740 | 0.382221 | 32.068400 | 25.105600 | 30.102400 | 31.223900 | 20.000000 |
| 0.310400 | 3 | 760 | 0.393573 | 31.869500 | 24.907200 | 29.931600 | 31.043200 | 20.000000 |
| 0.361200 | 3 | 780 | 0.383016 | 32.339000 | 25.427200 | 30.267200 | 31.476700 | 20.000000 |
| 0.321500 | 3 | 800 | 0.381312 | 31.966800 | 25.008000 | 30.008400 | 31.071000 | 20.000000 |
| 0.379600 | 3 | 820 | 0.389013 | 32.218900 | 25.378800 | 30.355500 | 31.413500 | 20.000000 |
| 0.346900 | 3 | 840 | 0.388966 | 31.900700 | 25.074500 | 30.031500 | 31.071600 | 20.000000 |
| 0.364500 | 3 | 860 | 0.382512 | 32.172200 | 25.309800 | 30.261900 | 31.279800 | 20.000000 |
| 0.279100 | 4 | 880 | 0.393970 | 31.498000 | 24.603300 | 29.558700 | 30.643000 | 20.000000 |
| 0.284700 | 4 | 900 | 0.391282 | 32.090000 | 25.168800 | 30.106400 | 31.227100 | 20.000000 |
| 0.301900 | 4 | 920 | 0.387117 | 32.137600 | 25.320700 | 30.234000 | 31.315000 | 20.000000 |
| 0.248700 | 4 | 940 | 0.393035 | 32.296800 | 25.379200 | 30.349900 | 31.486200 | 20.000000 |
| 0.302800 | 4 | 960 | 0.389426 | 32.488300 | 25.542800 | 30.532100 | 31.676000 | 20.000000 |
| 0.286500 | 4 | 980 | 0.405294 | 31.434500 | 24.362200 | 29.462400 | 30.605300 | 20.000000 |
| 0.282600 | 4 | 1000 | 0.391225 | 31.207100 | 24.081500 | 29.202400 | 30.333900 | 20.000000 |
| 0.258000 | 4 | 1020 | 0.392702 | 31.602000 | 24.586400 | 29.662000 | 30.753400 | 20.000000 |
| 0.276800 | 4 | 1040 | 0.385929 | 32.025900 | 24.915800 | 29.943700 | 31.137700 | 20.000000 |
| 0.280300 | 4 | 1060 | 0.395826 | 32.169600 | 25.301900 | 30.247000 | 31.350600 | 20.000000 |
| 0.307300 | 4 | 1080 | 0.391523 | 31.888500 | 24.968000 | 29.943900 | 31.068700 | 20.000000 |
| 0.290300 | 4 | 1100 | 0.378953 | 31.685000 | 24.868800 | 29.768200 | 30.838100 | 19.996500 |
| 0.285200 | 4 | 1120 | 0.384716 | 32.416400 | 25.605600 | 30.512500 | 31.584200 | 20.000000 |
| 0.280400 | 4 | 1140 | 0.383306 | 32.672600 | 25.866200 | 30.716700 | 31.826300 | 20.000000 |
| 0.301000 | 5 | 1160 | 0.388244 | 32.197300 | 25.377200 | 30.273700 | 31.360300 | 20.000000 |
| 0.259300 | 5 | 1180 | 0.394219 | 32.010500 | 24.821700 | 29.897100 | 31.045900 | 20.000000 |
| 0.229200 | 5 | 1200 | 0.399910 | 32.214100 | 25.272800 | 30.251200 | 31.332200 | 20.000000 |
| 0.265300 | 5 | 1220 | 0.399432 | 32.192400 | 25.345200 | 30.301100 | 31.364000 | 20.000000 |
| 0.265700 | 5 | 1240 | 0.400144 | 32.580400 | 25.887700 | 30.779800 | 31.800300 | 20.000000 |
| 0.235700 | 5 | 1260 | 0.389669 | 32.012300 | 25.066600 | 30.066500 | 31.202000 | 20.000000 |
| 0.268700 | 5 | 1280 | 0.385898 | 32.177500 | 25.199600 | 30.209200 | 31.331900 | 20.000000 |
| 0.240600 | 5 | 1300 | 0.384041 | 32.670000 | 25.872200 | 30.733200 | 31.822900 | 20.000000 |
| 0.240700 | 5 | 1320 | 0.387255 | 32.621700 | 25.810900 | 30.683900 | 31.748300 | 20.000000 |
| 0.242600 | 5 | 1340 | 0.393272 | 32.377200 | 25.487800 | 30.431500 | 31.525700 | 20.000000 |
| 0.267400 | 5 | 1360 | 0.390408 | 32.208000 | 25.233600 | 30.202300 | 31.362000 | 20.000000 |
| 0.241300 | 5 | 1380 | 0.387935 | 32.259800 | 25.131100 | 30.247800 | 31.354100 | 20.000000 |
| 0.238400 | 5 | 1400 | 0.403618 | 32.174700 | 25.150600 | 30.093700 | 31.344200 | 20.000000 |
| 0.259000 | 5 | 1420 | 0.396614 | 32.334800 | 25.372900 | 30.350300 | 31.511000 | 20.000000 |
| 0.243700 | 5 | 1440 | 0.397254 | 31.815800 | 24.716500 | 29.728900 | 30.880300 | 20.000000 |
| 0.201600 | 6 | 1460 | 0.395704 | 32.305900 | 25.363600 | 30.297500 | 31.433500 | 20.000000 |
| 0.205100 | 6 | 1480 | 0.396571 | 32.182700 | 25.160200 | 30.121500 | 31.282700 | 20.000000 |
| 0.224200 | 6 | 1500 | 0.398343 | 32.439600 | 25.334300 | 30.381300 | 31.509700 | 20.000000 |
| 0.224900 | 6 | 1520 | 0.395585 | 32.333800 | 25.477100 | 30.410600 | 31.494400 | 20.000000 |
| 0.216700 | 6 | 1540 | 0.404786 | 32.014500 | 25.052800 | 30.045800 | 31.203900 | 20.000000 |
| 0.227300 | 6 | 1560 | 0.397305 | 32.342300 | 25.545600 | 30.468800 | 31.516000 | 20.000000 |
| 0.211700 | 6 | 1580 | 0.401612 | 32.274000 | 25.443900 | 30.276200 | 31.440300 | 20.000000 |
| 0.210700 | 6 | 1600 | 0.399011 | 32.389400 | 25.518800 | 30.492800 | 31.613000 | 20.000000 |
| 0.230600 | 6 | 1620 | 0.393134 | 32.612400 | 25.817900 | 30.717100 | 31.801300 | 20.000000 |
| 0.201000 | 6 | 1640 | 0.401414 | 32.349800 | 25.302800 | 30.293100 | 31.457500 | 20.000000 |
| 0.211600 | 6 | 1660 | 0.391455 | 32.270900 | 25.483600 | 30.308200 | 31.460700 | 20.000000 |
| 0.198700 | 6 | 1680 | 0.396596 | 32.233000 | 25.212400 | 30.236400 | 31.355600 | 20.000000 |
| 0.226300 | 6 | 1700 | 0.401143 | 32.192100 | 25.220900 | 30.281400 | 31.391900 | 20.000000 |
| 0.238600 | 6 | 1720 | 0.391453 | 32.439000 | 25.479100 | 30.479800 | 31.613700 | 20.000000 |
| 0.200700 | 7 | 1740 | 0.398769 | 32.487600 | 25.642500 | 30.515500 | 31.662900 | 20.000000 |
| 0.186400 | 7 | 1760 | 0.400294 | 32.287400 | 25.251000 | 30.308100 | 31.437800 | 20.000000 |
| 0.176800 | 7 | 1780 | 0.406219 | 32.325100 | 25.401000 | 30.325000 | 31.505900 | 20.000000 |
| 0.190600 | 7 | 1800 | 0.398379 | 32.165700 | 25.140900 | 30.198300 | 31.349800 | 20.000000 |
| 0.177100 | 7 | 1820 | 0.406410 | 32.454800 | 25.475800 | 30.490200 | 31.540900 | 20.000000 |
| 0.198700 | 7 | 1840 | 0.396886 | 32.274000 | 25.247900 | 30.223400 | 31.407500 | 20.000000 |
| 0.196200 | 7 | 1860 | 0.407596 | 32.348300 | 25.156900 | 30.238300 | 31.413000 | 20.000000 |
| 0.167400 | 7 | 1880 | 0.405560 | 32.382000 | 25.506300 | 30.377600 | 31.519900 | 20.000000 |
| 0.198800 | 7 | 1900 | 0.409359 | 32.281700 | 25.331500 | 30.271900 | 31.423700 | 20.000000 |
| 0.202900 | 7 | 1920 | 0.405715 | 32.192000 | 25.054400 | 30.103300 | 31.341200 | 20.000000 |
| 0.210100 | 7 | 1940 | 0.402631 | 32.375500 | 25.331800 | 30.371700 | 31.527100 | 20.000000 |
| 0.199200 | 7 | 1960 | 0.403153 | 32.261700 | 25.227800 | 30.275300 | 31.404700 | 20.000000 |
| 0.192400 | 7 | 1980 | 0.406693 | 32.438400 | 25.486300 | 30.438700 | 31.580000 | 20.000000 |
| 0.210000 | 7 | 2000 | 0.397093 | 32.487200 | 25.537200 | 30.542800 | 31.687500 | 20.000000 |
| 0.186300 | 8 | 2020 | 0.403671 | 32.530700 | 25.529700 | 30.503900 | 31.651400 | 20.000000 |
| 0.171200 | 8 | 2040 | 0.406167 | 32.297300 | 25.244400 | 30.216400 | 31.406900 | 20.000000 |
| 0.159600 | 8 | 2060 | 0.413590 | 32.562300 | 25.551500 | 30.551000 | 31.677700 | 20.000000 |
| 0.191000 | 8 | 2080 | 0.406790 | 32.380000 | 25.326200 | 30.374900 | 31.476300 | 20.000000 |
| 0.149700 | 8 | 2100 | 0.419098 | 32.253200 | 25.283000 | 30.321300 | 31.422500 | 20.000000 |
| 0.174500 | 8 | 2120 | 0.410545 | 32.492700 | 25.497000 | 30.516600 | 31.623100 | 20.000000 |
| 0.178600 | 8 | 2140 | 0.405749 | 32.109100 | 25.057800 | 30.142800 | 31.178700 | 20.000000 |
| 0.172400 | 8 | 2160 | 0.413341 | 32.336500 | 25.260200 | 30.329000 | 31.456300 | 20.000000 |
| 0.199200 | 8 | 2180 | 0.402256 | 32.643900 | 25.630300 | 30.712600 | 31.744700 | 20.000000 |
| 0.182100 | 8 | 2200 | 0.401074 | 32.437400 | 25.420100 | 30.451300 | 31.558200 | 20.000000 |
| 0.165800 | 8 | 2220 | 0.408149 | 32.433600 | 25.306700 | 30.407500 | 31.537000 | 20.000000 |
| 0.164100 | 8 | 2240 | 0.407869 | 32.282900 | 25.398100 | 30.395100 | 31.471400 | 20.000000 |
| 0.174300 | 8 | 2260 | 0.412621 | 32.169700 | 25.171700 | 30.176700 | 31.304600 | 20.000000 |
| 0.178600 | 8 | 2280 | 0.407604 | 32.385700 | 25.380600 | 30.372900 | 31.494000 | 20.000000 |
| 0.160200 | 8 | 2300 | 0.408272 | 32.505100 | 25.568400 | 30.517300 | 31.657300 | 20.000000 |
| 0.166700 | 9 | 2320 | 0.405484 | 32.621300 | 25.726500 | 30.674400 | 31.786200 | 20.000000 |
| 0.148800 | 9 | 2340 | 0.413829 | 32.275700 | 25.185000 | 30.272300 | 31.355000 | 20.000000 |
| 0.161400 | 9 | 2360 | 0.413913 | 32.372700 | 25.201000 | 30.301500 | 31.506300 | 20.000000 |
| 0.155800 | 9 | 2380 | 0.414684 | 32.420600 | 25.395400 | 30.461500 | 31.533400 | 20.000000 |
| 0.170600 | 9 | 2400 | 0.403257 | 32.243600 | 25.152100 | 30.174700 | 31.333500 | 20.000000 |
| 0.162600 | 9 | 2420 | 0.408112 | 32.190200 | 25.136800 | 30.135900 | 31.295100 | 20.000000 |
| 0.160200 | 9 | 2440 | 0.413158 | 32.240100 | 25.255300 | 30.259300 | 31.391600 | 20.000000 |
| 0.165300 | 9 | 2460 | 0.408876 | 32.117800 | 24.999500 | 30.075400 | 31.187300 | 20.000000 |
| 0.157700 | 9 | 2480 | 0.418658 | 32.182700 | 25.065800 | 30.117200 | 31.251900 | 20.000000 |
| 0.152900 | 9 | 2500 | 0.412553 | 32.137700 | 25.021900 | 30.136700 | 31.234400 | 20.000000 |
| 0.153500 | 9 | 2520 | 0.411657 | 31.994400 | 24.742300 | 29.874600 | 31.051900 | 20.000000 |
| 0.152500 | 9 | 2540 | 0.404253 | 32.366500 | 25.086700 | 30.228600 | 31.393000 | 20.000000 |
| 0.163500 | 9 | 2560 | 0.406488 | 32.474000 | 25.284700 | 30.419900 | 31.541900 | 20.000000 |
| 0.175700 | 9 | 2580 | 0.406476 | 32.314300 | 25.101900 | 30.219300 | 31.342900 | 20.000000 |
| 0.156500 | 10 | 2600 | 0.411366 | 32.325400 | 25.088200 | 30.230000 | 31.382600 | 20.000000 |
| 0.147800 | 10 | 2620 | 0.411610 | 32.174600 | 24.935000 | 30.134600 | 31.225900 | 20.000000 |
| 0.154600 | 10 | 2640 | 0.416763 | 32.064800 | 24.824400 | 30.005100 | 31.147300 | 20.000000 |
| 0.147300 | 10 | 2660 | 0.413373 | 32.138200 | 24.856000 | 30.081100 | 31.209300 | 20.000000 |
| 0.140600 | 10 | 2680 | 0.416898 | 32.196500 | 25.032400 | 30.171700 | 31.282600 | 20.000000 |
| 0.146600 | 10 | 2700 | 0.414243 | 32.321500 | 25.131500 | 30.251500 | 31.376800 | 20.000000 |
| 0.154300 | 10 | 2720 | 0.411708 | 32.302400 | 25.028000 | 30.196800 | 31.338300 | 20.000000 |
| 0.146000 | 10 | 2740 | 0.412115 | 32.343600 | 25.191900 | 30.302900 | 31.403900 | 20.000000 |
| 0.140000 | 10 | 2760 | 0.414298 | 32.244000 | 25.085400 | 30.180300 | 31.292300 | 20.000000 |
| 0.150100 | 10 | 2780 | 0.416827 | 32.313100 | 25.206500 | 30.260700 | 31.390100 | 20.000000 |
| 0.153400 | 10 | 2800 | 0.415130 | 32.392200 | 25.266000 | 30.320600 | 31.461100 | 20.000000 |
| 0.143600 | 10 | 2820 | 0.414414 | 32.394300 | 25.249800 | 30.313800 | 31.445400 | 20.000000 |
| 0.153400 | 10 | 2840 | 0.414328 | 32.427100 | 25.294400 | 30.359600 | 31.485100 | 20.000000 |
| 0.145300 | 10 | 2860 | 0.414271 | 32.362800 | 25.219700 | 30.281900 | 31.420600 | 20.000000 |
| 0.135500 | 10 | 2880 | 0.414513 | 32.399800 | 25.275900 | 30.322200 | 31.459500 | 20.000000 |
