Whisper finetuned for ceb
This model is a fine-tuned version of openai/whisper-tiny on the Fleurs Ceb subset dataset.
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 100
- training_steps: 20000
- mixed_precision_training: Native AMP
Framework versions
- Transformers 4.35.0.dev0
- Pytorch 2.0.1+cu118
- Datasets 2.14.5
- Tokenizers 0.14.1
| Step | Training Loss | Validation Loss | Wer | Wer Un Norm | Bleu | Bleu Un Norm |
|---|---|---|---|---|---|---|
| 100 | 4.561800 | 2.756816 | 622.425209 | 620.677735 | 0.264869 | 0.273623 |
| 200 | 2.623700 | 2.488487 | 341.612295 | 328.983884 | 0.914517 | 0.967359 |
| 300 | 2.402200 | 2.358448 | 342.235755 | 309.002386 | 1.181677 | 1.299669 |
| 400 | 2.209400 | 2.276091 | 255.961529 | 240.912411 | 2.103979 | 2.316627 |
| 500 | 2.167900 | 2.195426 | 252.027452 | 234.870247 | 2.397484 | 2.668299 |
| 600 | 2.098600 | 2.135680 | 235.991494 | 221.919276 | 2.862503 | 3.123342 |
| 700 | 2.003600 | 2.083335 | 167.357788 | 166.682896 | 4.308508 | 4.518109 |
| 800 | 1.878700 | 2.048033 | 188.623073 | 178.538390 | 4.000726 | 4.325173 |
| 900 | 1.711100 | 2.016501 | 199.545696 | 193.870198 | 3.933154 | 4.168942 |
| 1000 | 1.636500 | 1.996687 | 138.770480 | 137.504260 | 5.933034 | 6.049878 |
| 1100 | 1.605300 | 1.967516 | 178.860374 | 172.369638 | 4.831093 | 5.163210 |
| 1200 | 1.604600 | 1.941783 | 150.360060 | 148.210721 | 5.980591 | 6.096744 |
| 1300 | 1.610100 | 1.919571 | 158.547194 | 157.028093 | 5.598866 | 5.803798 |
| 1400 | 1.552200 | 1.899135 | 128.340825 | 126.086957 | 7.186688 | 7.598258 |
| 1500 | 1.474300 | 1.885681 | 127.451549 | 123.102391 | 7.365957 | 7.880490 |
| 1600 | 1.342500 | 1.876069 | 129.597410 | 129.115342 | 7.715292 | 8.174594 |
| 1700 | 1.248100 | 1.870864 | 162.258953 | 160.903647 | 6.386770 | 6.648647 |
| 1800 | 1.284400 | 1.862517 | 137.151418 | 136.403915 | 7.706158 | 7.965985 |
| 1900 | 1.241900 | 1.845586 | 167.536610 | 167.807586 | 6.374425 | 6.606844 |
| 2000 | 1.229400 | 1.834395 | 132.110579 | 128.170797 | 8.183137 | 8.677079 |
| 2100 | 1.219000 | 1.826037 | 126.794258 | 123.925215 | 8.626434 | 8.840388 |
| 2200 | 1.193000 | 1.815286 | 132.347397 | 129.412338 | 8.336166 | 8.739044 |
| 2300 | 1.165800 | 1.807982 | 137.455899 | 135.493451 | 8.254358 | 8.800243 |
| 2400 | 0.984700 | 1.811018 | 125.141366 | 124.723696 | 9.070674 | 9.380558 |
| 2500 | 1.008000 | 1.811256 | 117.239379 | 116.709674 | 9.632171 | 10.134365 |
| 2600 | 0.968100 | 1.808063 | 121.627761 | 125.122937 | 9.606440 | 9.555828 |
| 2700 | 0.960600 | 1.811303 | 115.030690 | 114.966649 | 9.976183 | 10.435646 |
| 2800 | 0.957900 | 1.798109 | 119.907206 | 126.904913 | 9.815675 | 9.312249 |
| 2900 | 0.965900 | 1.796450 | 130.858828 | 131.359852 | 9.106916 | 9.364030 |
| 3000 | 0.919500 | 1.788308 | 114.484559 | 111.952870 | 10.292400 | 10.997919 |
| 3100 | 0.886400 | 1.813696 | 129.215601 | 129.835922 | 9.176136 | 9.450987 |
| 3200 | 0.759800 | 1.812548 | 111.415591 | 112.181703 | 10.631406 | 10.966518 |
| 3300 | 0.776000 | 1.812027 | 125.426514 | 124.100492 | 9.697673 | 10.117979 |
| 3400 | 0.749500 | 1.814985 | 130.153207 | 128.360680 | 9.380285 | 9.781452 |
| 3500 | 0.750000 | 1.812432 | 120.883476 | 119.231706 | 10.157927 | 10.395983 |
| 3600 | 0.760900 | 1.814862 | 116.219612 | 114.090267 | 10.591337 | 11.176135 |
| 3700 | 0.770000 | 1.807506 | 133.869798 | 135.644384 | 9.391964 | 9.770737 |
| 3800 | 0.715700 | 1.810225 | 116.499928 | 117.873314 | 10.795849 | 11.056394 |
| 3900 | 0.616700 | 1.828975 | 105.408148 | 107.264229 | 11.777285 | 11.909773 |
| 4000 | 0.607500 | 1.833726 | 117.002562 | 114.177905 | 10.816948 | 11.565005 |
| 4100 | 0.599400 | 1.842073 | 114.987192 | 117.099177 | 10.904386 | 10.967700 |
| 4200 | 0.584600 | 1.830304 | 117.055725 | 117.897658 | 10.914152 | 11.308385 |
| 4300 | 0.559600 | 1.840000 | 118.230148 | 118.248211 | 10.607127 | 10.699382 |
| 4400 | 0.584000 | 1.836431 | 101.280750 | 100.511223 | 12.577582 | 13.109015 |
| 4500 | 0.582900 | 1.840835 | 126.190131 | 129.193242 | 10.161741 | 10.117381 |
| 4600 | 0.578800 | 1.849879 | 112.507854 | 112.415405 | 11.201782 | 11.647988 |
| 4700 | 0.442600 | 1.871504 | 110.429655 | 112.133015 | 11.482354 | 11.615616 |
| 4800 | 0.450600 | 1.872254 | 121.714755 | 118.087541 | 10.733760 | 11.564663 |
| 4900 | 0.458900 | 1.891750 | 122.169059 | 122.055602 | 10.354607 | 10.643605 |
| 5000 | 0.453800 | 1.887707 | 127.973515 | 129.446419 | 10.062027 | 10.368371 |
| 5100 | 0.437400 | 1.891465 | 109.521048 | 111.178733 | 11.669781 | 12.147493 |
| 5200 | 0.453300 | 1.888580 | 112.280702 | 113.121379 | 11.647065 | 12.010356 |
| 5300 | 0.462400 | 1.896828 | 111.536417 | 112.897415 | 11.683536 | 11.987849 |
| 5400 | 0.397000 | 1.919457 | 102.508337 | 102.935878 | 12.805154 | 13.209617 |
| 5500 | 0.334900 | 1.923952 | 111.894060 | 113.243098 | 11.724963 | 12.156799 |
| 5600 | 0.338900 | 1.928548 | 108.945919 | 108.822241 | 11.810663 | 12.369885 |
| 5700 | 0.347700 | 1.929924 | 120.777149 | 118.481912 | 10.892551 | 11.544916 |
| 5800 | 0.346100 | 1.936318 | 133.889131 | 133.477774 | 10.077502 | 10.530322 |
| 5900 | 0.353800 | 1.940949 | 114.387898 | 113.233361 | 11.483227 | 12.146382 |
| 6000 | 0.336300 | 1.950407 | 122.623363 | 122.386679 | 10.708862 | 11.206821 |
| 6100 | 0.333500 | 1.947361 | 121.864579 | 123.871659 | 11.012294 | 11.294616 |
| 6200 | 0.273200 | 1.972487 | 112.981490 | 115.068893 | 11.696579 | 11.884550 |
| 6300 | 0.255200 | 1.973960 | 130.945822 | 131.491309 | 10.378255 | 10.881664 |
| 6400 | 0.249700 | 1.980103 | 116.528926 | 117.556843 | 11.372183 | 11.681537 |
| 6500 | 0.269000 | 1.986091 | 117.635687 | 117.240372 | 11.490022 | 11.944798 |
| 6600 | 0.259600 | 1.989834 | 111.222271 | 110.633429 | 12.113969 | 12.684477 |
| 6700 | 0.247000 | 1.997728 | 118.481465 | 118.253080 | 11.288208 | 11.560813 |
| 6800 | 0.264800 | 2.003190 | 118.471799 | 119.777010 | 11.365537 | 11.669104 |
| 6900 | 0.253100 | 2.011689 | 110.816297 | 111.057013 | 12.204550 | 12.724644 |
| 7000 | 0.183100 | 2.041850 | 103.426611 | 101.947514 | 12.862486 | 13.342944 |
| 7100 | 0.187900 | 2.049592 | 113.706442 | 114.586883 | 11.651463 | 11.975561 |
| 7200 | 0.185700 | 2.049776 | 120.076362 | 118.657189 | 11.142231 | 11.449773 |
| 7300 | 0.193800 | 2.063047 | 110.535982 | 114.314231 | 12.063553 | 12.305161 |
| 7400 | 0.194000 | 2.053908 | 110.043014 | 111.616924 | 12.126284 | 12.539698 |