<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
wav2vec_on_grid
This model is a fine-tuned version of facebook/wav2vec2-base-960h on the None dataset. It achieves the following results on the evaluation set:
- Loss: -0.3810
- Wer: 0.1345
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- num_epochs: 50
Training results
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 3.1549 | 2.86 | 500 | 0.5346 | 0.5909 |
| 0.4979 | 5.71 | 1000 | 0.0507 | 0.4645 |
| 0.0943 | 8.57 | 1500 | -0.1675 | 0.3417 |
| -0.1114 | 11.43 | 2000 | -0.3079 | 0.2426 |
| -0.21 | 14.29 | 2500 | -0.3226 | 0.2126 |
| -0.2397 | 17.14 | 3000 | -0.3238 | 0.2052 |
| -0.2884 | 20.0 | 3500 | -0.3635 | 0.1694 |
| -0.307 | 22.86 | 4000 | -0.3726 | 0.1540 |
| -0.3311 | 25.71 | 4500 | -0.3647 | 0.1520 |
| -0.348 | 28.57 | 5000 | -0.3889 | 0.1362 |
| -0.3596 | 31.43 | 5500 | -0.3726 | 0.1467 |
| -0.366 | 34.29 | 6000 | -0.3865 | 0.1364 |
| -0.3758 | 37.14 | 6500 | -0.3841 | 0.1398 |
| -0.3876 | 40.0 | 7000 | -0.3451 | 0.1485 |
| -0.3983 | 42.86 | 7500 | -0.3905 | 0.1350 |
| -0.4015 | 45.71 | 8000 | -0.3834 | 0.1362 |
| -0.4067 | 48.57 | 8500 | -0.3810 | 0.1345 |
Framework versions
- Transformers 4.27.1
- Pytorch 1.13.1+cu116
- Datasets 2.10.1
- Tokenizers 0.13.2
