<!-- This model card has been generated automatically according to the information Keras had access to. You should probably proofread and complete it, then remove this comment. -->
whisper_4_with_init_sun_syl_wd_0_lr_7en5_0015
This model is a fine-tuned version of openai/whisper-tiny on an unknown dataset. It achieves the following results on the evaluation set:
- Train Loss: 0.4550
- Train Accuracy: 0.0313
- Train Wermet: 0.0971
- Train Wermet Syl: 0.1409
- Validation Loss: 0.9789
- Validation Accuracy: 0.0211
- Validation Wermet: 0.2876
- Validation Wermet Syl: 0.2732
- Epoch: 14
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 7e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0}
- training_precision: float32
Training results
| Train Loss | Train Accuracy | Train Wermet | Train Wermet Syl | Validation Loss | Validation Accuracy | Validation Wermet | Validation Wermet Syl | Epoch |
|---|---|---|---|---|---|---|---|---|
| 4.9248 | 0.0113 | 1.1777 | 1.1068 | 3.9252 | 0.0115 | 0.9215 | 0.8812 | 0 |
| 4.6658 | 0.0117 | 0.8497 | 0.8066 | 3.9186 | 0.0113 | 0.9766 | 0.9699 | 1 |
| 4.6144 | 0.0118 | 0.8224 | 0.7735 | 3.8791 | 0.0115 | 0.9336 | 0.9042 | 2 |
| 4.5388 | 0.0120 | 0.7917 | 0.7466 | 3.6581 | 0.0120 | 0.8508 | 0.8073 | 3 |
| 4.0826 | 0.0133 | 0.7361 | 0.6973 | 2.7406 | 0.0139 | 0.7479 | 0.7097 | 4 |
| 3.0292 | 0.0166 | 0.6273 | 0.6290 | 1.8185 | 0.0170 | 0.5529 | 0.5186 | 5 |
| 2.1435 | 0.0203 | 0.4839 | 0.5224 | 1.6075 | 0.0176 | 0.4395 | 0.4097 | 6 |
| 1.6289 | 0.0228 | 0.3883 | 0.4416 | 1.1774 | 0.0197 | 0.3770 | 0.3490 | 7 |
| 1.2619 | 0.0250 | 0.3256 | 0.3991 | 1.1074 | 0.0201 | 0.3404 | 0.3137 | 8 |
| 1.0044 | 0.0268 | 0.2703 | 0.3518 | 1.0470 | 0.0205 | 0.3204 | 0.2976 | 9 |
| 0.8528 | 0.0279 | 0.2202 | 0.2912 | 0.9859 | 0.0209 | 0.3069 | 0.2809 | 10 |
| 0.7298 | 0.0289 | 0.1801 | 0.2406 | 0.9461 | 0.0212 | 0.2943 | 0.2720 | 11 |
| 0.6258 | 0.0297 | 0.1448 | 0.1973 | 0.9400 | 0.0214 | 0.2853 | 0.2618 | 12 |
| 0.5089 | 0.0308 | 0.1191 | 0.1700 | 0.9320 | 0.0214 | 0.2849 | 0.2608 | 13 |
| 0.4550 | 0.0313 | 0.0971 | 0.1409 | 0.9789 | 0.0211 | 0.2876 | 0.2732 | 14 |
Framework versions
- Transformers 4.34.0.dev0
- TensorFlow 2.13.0
- Tokenizers 0.13.3
