<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
wav2vec2-xls-r-300m-ar-12
This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the common_voice dataset. It achieves the following results on the evaluation set:
- Loss: 77.9014
- Wer: 0.1633
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 64
- eval_batch_size: 16
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 256
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- num_epochs: 200
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 16832.9559 | 1.0 | 85 | 1596.5383 | 1.0 |
| 4748.8934 | 2.0 | 170 | 698.8426 | 1.0 |
| 2939.1952 | 3.0 | 255 | 633.2770 | 1.0 |
| 2833.7857 | 4.0 | 340 | 615.9734 | 1.0 |
| 2778.75 | 5.0 | 425 | 609.7852 | 1.0 |
| 2603.4421 | 6.0 | 510 | 435.0911 | 0.9998 |
| 1420.6594 | 7.0 | 595 | 165.1980 | 0.7542 |
| 811.7357 | 8.0 | 680 | 117.7532 | 0.5570 |
| 582.7924 | 9.0 | 765 | 93.8724 | 0.4447 |
| 469.1885 | 10.0 | 850 | 87.4084 | 0.3961 |
| 399.7348 | 11.0 | 935 | 78.7740 | 0.3562 |
| 348.0169 | 12.0 | 1020 | 72.9545 | 0.3278 |
| 314.0225 | 13.0 | 1105 | 70.8449 | 0.3149 |
| 281.4823 | 14.0 | 1190 | 66.1416 | 0.3013 |
| 263.0267 | 15.0 | 1275 | 66.6624 | 0.2761 |
| 238.7656 | 16.0 | 1360 | 66.3659 | 0.2742 |
| 227.9712 | 17.0 | 1445 | 65.1213 | 0.2616 |
| 209.4785 | 18.0 | 1530 | 66.3502 | 0.2600 |
| 198.6275 | 19.0 | 1615 | 66.7867 | 0.2589 |
| 189.7333 | 20.0 | 1700 | 65.1457 | 0.2499 |
| 183.3984 | 21.0 | 1785 | 68.7480 | 0.2534 |
| 174.6036 | 22.0 | 1870 | 67.8124 | 0.2480 |
| 167.1744 | 23.0 | 1955 | 70.3643 | 0.2438 |
| 160.6194 | 24.0 | 2040 | 68.3434 | 0.2387 |
| 154.096 | 25.0 | 2125 | 69.3449 | 0.2391 |
| 148.2008 | 26.0 | 2210 | 66.6332 | 0.2359 |
| 143.9339 | 27.0 | 2295 | 67.2253 | 0.2292 |
| 143.2862 | 28.0 | 2380 | 68.5232 | 0.2299 |
| 136.5192 | 29.0 | 2465 | 71.3180 | 0.2286 |
| 138.1667 | 30.0 | 2550 | 68.1166 | 0.2241 |
| 129.6961 | 31.0 | 2635 | 69.9885 | 0.2270 |
| 125.0034 | 32.0 | 2720 | 68.5696 | 0.2288 |
| 122.382 | 33.0 | 2805 | 69.9053 | 0.2237 |
| 121.4687 | 34.0 | 2890 | 72.5378 | 0.2325 |
| 121.637 | 35.0 | 2975 | 74.0948 | 0.2302 |
| 114.8182 | 36.0 | 3060 | 71.6004 | 0.2236 |
| 114.9692 | 37.0 | 3145 | 73.0708 | 0.2215 |
| 111.2695 | 38.0 | 3230 | 70.1939 | 0.2172 |
| 109.1332 | 39.0 | 3315 | 73.6910 | 0.2216 |
| 109.5747 | 40.0 | 3400 | 73.0911 | 0.2192 |
| 112.0337 | 41.0 | 3485 | 72.5238 | 0.2285 |
| 102.5452 | 42.0 | 3570 | 73.1730 | 0.2156 |
| 104.4951 | 43.0 | 3655 | 70.9824 | 0.2116 |
| 100.2483 | 44.0 | 3740 | 77.4810 | 0.2141 |
| 100.7275 | 45.0 | 3825 | 70.5330 | 0.2131 |
| 97.4453 | 46.0 | 3910 | 69.3713 | 0.2117 |
| 97.4768 | 47.0 | 3995 | 78.6786 | 0.2150 |
| 97.9564 | 48.0 | 4080 | 74.7395 | 0.2080 |
| 95.7626 | 49.0 | 4165 | 73.5510 | 0.2165 |
| 94.4995 | 50.0 | 4250 | 71.3337 | 0.2152 |
| 92.4394 | 51.0 | 4335 | 74.3506 | 0.2091 |
| 89.1442 | 52.0 | 4420 | 71.3629 | 0.2076 |
| 89.8932 | 53.0 | 4505 | 70.2986 | 0.2119 |
| 88.6913 | 54.0 | 4590 | 71.3645 | 0.2077 |
| 91.1411 | 55.0 | 4675 | 74.9795 | 0.2166 |
| 87.5678 | 56.0 | 4760 | 77.4106 | 0.2081 |
| 83.0826 | 57.0 | 4845 | 75.1502 | 0.2099 |
| 83.7437 | 58.0 | 4930 | 74.9253 | 0.2071 |
| 85.8112 | 59.0 | 5015 | 70.0373 | 0.2067 |
| 81.7675 | 60.0 | 5100 | 76.5425 | 0.2156 |
| 81.6714 | 61.0 | 5185 | 75.3845 | 0.2083 |
| 81.9356 | 62.0 | 5270 | 74.8665 | 0.2069 |
| 77.8237 | 63.0 | 5355 | 74.6538 | 0.2036 |
| 79.3037 | 64.0 | 5440 | 73.3461 | 0.2006 |
| 81.3878 | 65.0 | 5525 | 72.3601 | 0.2022 |
| 77.7095 | 66.0 | 5610 | 72.7715 | 0.2034 |
| 76.6013 | 67.0 | 5695 | 78.5694 | 0.2073 |
| 74.7015 | 68.0 | 5780 | 72.6246 | 0.2032 |
| 76.637 | 69.0 | 5865 | 73.9210 | 0.2095 |
| 74.1983 | 70.0 | 5950 | 75.4212 | 0.1995 |
| 73.328 | 71.0 | 6035 | 76.0840 | 0.1958 |
| 73.2174 | 72.0 | 6120 | 75.8443 | 0.2006 |
| 73.2776 | 73.0 | 6205 | 80.3562 | 0.2058 |
| 69.7834 | 74.0 | 6290 | 77.4640 | 0.2018 |
| 70.2896 | 75.0 | 6375 | 75.3303 | 0.1989 |
| 67.4863 | 76.0 | 6460 | 76.7881 | 0.2021 |
| 69.5997 | 77.0 | 6545 | 73.3460 | 0.1990 |
| 66.8822 | 78.0 | 6630 | 76.5326 | 0.2000 |
| 68.8483 | 79.0 | 6715 | 75.6460 | 0.1996 |
| 64.6421 | 80.0 | 6800 | 73.5708 | 0.1966 |
| 65.7658 | 81.0 | 6885 | 79.4043 | 0.1981 |
| 68.3581 | 82.0 | 6970 | 74.2181 | 0.1995 |
| 66.8769 | 83.0 | 7055 | 74.5230 | 0.1970 |
| 63.3021 | 84.0 | 7140 | 78.5190 | 0.1968 |
| 61.6227 | 85.0 | 7225 | 77.4760 | 0.1974 |
| 62.5638 | 86.0 | 7310 | 79.0764 | 0.1979 |
| 63.4932 | 87.0 | 7395 | 77.3330 | 0.1938 |
| 60.8015 | 88.0 | 7480 | 74.0066 | 0.1913 |
| 60.5176 | 89.0 | 7565 | 76.4915 | 0.1930 |
| 61.0698 | 90.0 | 7650 | 76.3846 | 0.1936 |
| 61.2012 | 91.0 | 7735 | 77.7306 | 0.1916 |
| 59.9138 | 92.0 | 7820 | 74.8689 | 0.1904 |
| 59.955 | 93.0 | 7905 | 77.6994 | 0.1921 |
| 60.1327 | 94.0 | 7990 | 77.2062 | 0.1896 |
| 57.2662 | 95.0 | 8075 | 78.6637 | 0.1926 |
| 60.3225 | 96.0 | 8160 | 79.5939 | 0.1921 |
| 56.1769 | 97.0 | 8245 | 79.2807 | 0.1917 |
| 56.4212 | 98.0 | 8330 | 76.9330 | 0.1904 |
| 55.0239 | 99.0 | 8415 | 76.5063 | 0.1890 |
| 54.8932 | 100.0 | 8500 | 76.7235 | 0.1866 |
| 55.0942 | 101.0 | 8585 | 74.4022 | 0.1875 |
| 53.9534 | 102.0 | 8670 | 76.1983 | 0.1855 |
| 54.8974 | 103.0 | 8755 | 74.1427 | 0.1834 |
| 53.0833 | 104.0 | 8840 | 74.4284 | 0.1845 |
| 54.4095 | 105.0 | 8925 | 73.8318 | 0.1840 |
| 53.0103 | 106.0 | 9010 | 75.3837 | 0.1858 |
| 52.1488 | 107.0 | 9095 | 75.4422 | 0.1845 |
| 52.6274 | 108.0 | 9180 | 81.5232 | 0.1882 |
| 49.8969 | 109.0 | 9265 | 76.7468 | 0.1905 |
| 50.2353 | 110.0 | 9350 | 77.5954 | 0.1889 |
| 48.6322 | 111.0 | 9435 | 77.4254 | 0.1868 |
| 49.8443 | 112.0 | 9520 | 75.5615 | 0.1834 |
| 48.3942 | 113.0 | 9605 | 75.4467 | 0.1829 |
| 50.5596 | 114.0 | 9690 | 76.4219 | 0.1894 |
| 49.3698 | 115.0 | 9775 | 74.8749 | 0.1846 |
| 49.8104 | 116.0 | 9860 | 77.8855 | 0.1846 |
| 46.308 | 117.0 | 9945 | 77.7105 | 0.1877 |
| 48.2955 | 118.0 | 10030 | 75.8736 | 0.1887 |
| 48.086 | 119.0 | 10115 | 78.3174 | 0.1856 |
| 47.3039 | 120.0 | 10200 | 77.9972 | 0.1818 |
| 44.4335 | 121.0 | 10285 | 77.9906 | 0.1831 |
| 44.79 | 122.0 | 10370 | 77.6622 | 0.1829 |
| 45.2491 | 123.0 | 10455 | 74.7864 | 0.1788 |
| 43.4817 | 124.0 | 10540 | 79.8335 | 0.1840 |
| 42.8565 | 125.0 | 10625 | 77.1184 | 0.1823 |
| 43.3137 | 126.0 | 10710 | 78.8980 | 0.1806 |
| 47.5019 | 127.0 | 10795 | 76.0757 | 0.1802 |
| 42.8448 | 128.0 | 10880 | 74.3782 | 0.1805 |
| 43.371 | 129.0 | 10965 | 75.9817 | 0.1763 |
| 42.5875 | 130.0 | 11050 | 75.2765 | 0.1790 |
| 41.3362 | 131.0 | 11135 | 76.6064 | 0.1771 |
| 42.0271 | 132.0 | 11220 | 75.4263 | 0.1784 |
| 39.8784 | 133.0 | 11305 | 77.8300 | 0.1794 |
| 40.6921 | 134.0 | 11390 | 78.6296 | 0.1792 |
| 39.4606 | 135.0 | 11475 | 79.6816 | 0.1778 |
| 37.5287 | 136.0 | 11560 | 78.0326 | 0.1782 |
| 41.5487 | 137.0 | 11645 | 77.2891 | 0.1758 |
| 41.2244 | 138.0 | 11730 | 75.5363 | 0.1758 |
| 38.8745 | 139.0 | 11815 | 78.4477 | 0.1757 |
| 39.4361 | 140.0 | 11900 | 74.8600 | 0.1745 |
| 37.9799 | 141.0 | 11985 | 74.5921 | 0.1767 |
| 40.0375 | 142.0 | 12070 | 75.4366 | 0.1755 |
| 38.1776 | 143.0 | 12155 | 76.9755 | 0.1757 |
| 39.0457 | 144.0 | 12240 | 78.5006 | 0.1783 |
| 36.8371 | 145.0 | 12325 | 74.9189 | 0.1755 |
| 36.6938 | 146.0 | 12410 | 78.4304 | 0.1746 |
| 35.208 | 147.0 | 12495 | 79.0332 | 0.1774 |
| 36.08 | 148.0 | 12580 | 77.9339 | 0.1746 |
| 37.4205 | 149.0 | 12665 | 76.0473 | 0.1748 |
| 36.1532 | 150.0 | 12750 | 77.6417 | 0.1740 |
| 36.4478 | 151.0 | 12835 | 77.7077 | 0.1740 |
| 35.2669 | 152.0 | 12920 | 77.4225 | 0.1728 |
| 33.9716 | 153.0 | 13005 | 76.0476 | 0.1722 |
| 33.7335 | 154.0 | 13090 | 75.8777 | 0.1717 |
| 33.2638 | 155.0 | 13175 | 78.7736 | 0.1716 |
| 32.744 | 156.0 | 13260 | 75.9818 | 0.1692 |
| 33.7618 | 157.0 | 13345 | 77.9544 | 0.1705 |
| 32.5823 | 158.0 | 13430 | 74.5033 | 0.1710 |
| 32.435 | 159.0 | 13515 | 77.1456 | 0.1703 |
| 32.631 | 160.0 | 13600 | 75.2885 | 0.1706 |
| 31.8537 | 161.0 | 13685 | 76.6699 | 0.1674 |
| 32.7374 | 162.0 | 13770 | 77.5112 | 0.1679 |
| 31.7985 | 163.0 | 13855 | 77.2261 | 0.1686 |
| 33.4709 | 164.0 | 13940 | 77.0829 | 0.1688 |
| 32.5837 | 165.0 | 14025 | 81.3337 | 0.1688 |
| 31.3551 | 166.0 | 14110 | 77.3803 | 0.1672 |
| 30.5367 | 167.0 | 14195 | 79.0103 | 0.1689 |
| 30.7095 | 168.0 | 14280 | 77.3184 | 0.1683 |
| 31.0545 | 169.0 | 14365 | 77.5170 | 0.1675 |
| 29.7835 | 170.0 | 14450 | 76.5517 | 0.1661 |
| 24.643 | 171.0 | 14535 | 77.7856 | 0.1684 |
| 29.8659 | 172.0 | 14620 | 78.2275 | 0.1689 |
| 29.8893 | 173.0 | 14705 | 76.9425 | 0.1677 |
| 29.0071 | 174.0 | 14790 | 76.2374 | 0.1674 |
| 28.8064 | 175.0 | 14875 | 77.7253 | 0.1657 |
| 28.1371 | 176.0 | 14960 | 77.0664 | 0.1666 |
| 28.3809 | 177.0 | 15045 | 77.4184 | 0.1659 |
| 27.953 | 178.0 | 15130 | 77.5284 | 0.1651 |
| 29.4455 | 179.0 | 15215 | 76.8801 | 0.1647 |
| 27.7792 | 180.0 | 15300 | 75.6964 | 0.1638 |
| 29.7077 | 181.0 | 15385 | 77.7636 | 0.1648 |
| 28.0373 | 182.0 | 15470 | 77.2047 | 0.1655 |
| 27.5775 | 183.0 | 15555 | 77.2836 | 0.1631 |
| 26.3244 | 184.0 | 15640 | 77.2574 | 0.1645 |
| 27.4902 | 185.0 | 15725 | 77.4289 | 0.1649 |
| 27.4503 | 186.0 | 15810 | 76.1098 | 0.1636 |
| 25.7041 | 187.0 | 15895 | 77.4126 | 0.1627 |
| 26.0029 | 188.0 | 15980 | 77.8391 | 0.1640 |
| 26.2039 | 189.0 | 16065 | 77.9678 | 0.1644 |
| 25.3233 | 190.0 | 16150 | 77.9595 | 0.1636 |
| 26.3017 | 191.0 | 16235 | 77.7247 | 0.1640 |
| 25.3848 | 192.0 | 16320 | 77.0303 | 0.1631 |
| 26.489 | 193.0 | 16405 | 77.0221 | 0.1632 |
| 24.5612 | 194.0 | 16490 | 77.1831 | 0.1632 |
| 24.3228 | 195.0 | 16575 | 77.3499 | 0.1638 |
| 24.7961 | 196.0 | 16660 | 77.6399 | 0.1633 |
| 26.368 | 197.0 | 16745 | 77.8759 | 0.1639 |
| 26.0979 | 198.0 | 16830 | 77.9501 | 0.1634 |
| 26.2053 | 199.0 | 16915 | 77.8439 | 0.1633 |
| 25.9718 | 200.0 | 17000 | 77.9014 | 0.1633 |
Framework versions
- Transformers 4.17.0
- Pytorch 1.11.0
- Datasets 1.18.4
- Tokenizers 0.12.1
