<!-- This model card has been generated automatically according to the information Keras had access to. You should probably proofread and complete it, then remove this comment. -->
whisper_4_with_init_sun__0030
This model is a fine-tuned version of openai/whisper-tiny on an unknown dataset. It achieves the following results on the evaluation set:
- Train Loss: 1.6401
- Train Accuracy: 0.0232
- Train Wermet: 0.3867
- Validation Loss: 1.4891
- Validation Accuracy: 0.0185
- Validation Wermet: 0.4548
- Epoch: 29
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 1e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
- training_precision: float32
Training results
| Train Loss | Train Accuracy | Train Wermet | Validation Loss | Validation Accuracy | Validation Wermet | Epoch |
|---|---|---|---|---|---|---|
| 5.3333 | 0.0111 | 1.3132 | 3.9675 | 0.0114 | 0.9339 | 0 |
| 4.7131 | 0.0116 | 0.8607 | 3.9360 | 0.0114 | 0.9503 | 1 |
| 4.6717 | 0.0117 | 0.8449 | 3.9196 | 0.0113 | 0.9768 | 2 |
| 4.6474 | 0.0117 | 0.8338 | 3.9039 | 0.0114 | 0.9557 | 3 |
| 4.6273 | 0.0118 | 0.8243 | 3.8721 | 0.0115 | 0.9414 | 4 |
| 4.6101 | 0.0118 | 0.8167 | 3.8629 | 0.0116 | 0.9156 | 5 |
| 4.5912 | 0.0119 | 0.7985 | 3.8361 | 0.0116 | 0.8988 | 6 |
| 4.5645 | 0.0120 | 0.7753 | 3.8298 | 0.0116 | 0.9045 | 7 |
| 4.5386 | 0.0121 | 0.7558 | 3.7904 | 0.0118 | 0.8426 | 8 |
| 4.5075 | 0.0122 | 0.7405 | 3.7472 | 0.0119 | 0.8103 | 9 |
| 4.4586 | 0.0124 | 0.7255 | 3.7163 | 0.0120 | 0.8189 | 10 |
| 4.3978 | 0.0126 | 0.7174 | 3.6168 | 0.0122 | 0.8163 | 11 |
| 4.3031 | 0.0128 | 0.7107 | 3.4956 | 0.0125 | 0.7847 | 12 |
| 4.1606 | 0.0133 | 0.7025 | 3.3414 | 0.0128 | 0.7897 | 13 |
| 3.9636 | 0.0138 | 0.6991 | 3.1311 | 0.0133 | 0.7495 | 14 |
| 3.7290 | 0.0145 | 0.6827 | 2.8892 | 0.0139 | 0.7292 | 15 |
| 3.4993 | 0.0152 | 0.6643 | 2.7195 | 0.0143 | 0.7129 | 16 |
| 3.2810 | 0.0159 | 0.6448 | 2.5418 | 0.0148 | 0.6803 | 17 |
| 3.0604 | 0.0167 | 0.6182 | 2.3572 | 0.0153 | 0.6538 | 18 |
| 2.8748 | 0.0174 | 0.5946 | 2.2575 | 0.0156 | 0.6337 | 19 |
| 2.6889 | 0.0181 | 0.5699 | 2.0988 | 0.0162 | 0.6016 | 20 |
| 2.5493 | 0.0187 | 0.5449 | 1.9878 | 0.0166 | 0.5834 | 21 |
| 2.3921 | 0.0194 | 0.5207 | 1.9029 | 0.0168 | 0.5597 | 22 |
| 2.2491 | 0.0201 | 0.4987 | 1.8642 | 0.0169 | 0.5409 | 23 |
| 2.1254 | 0.0207 | 0.4766 | 1.7354 | 0.0175 | 0.5231 | 24 |
| 1.9980 | 0.0213 | 0.4552 | 1.6661 | 0.0178 | 0.5049 | 25 |
| 1.9147 | 0.0217 | 0.4382 | 1.6140 | 0.0180 | 0.4921 | 26 |
| 1.8008 | 0.0223 | 0.4196 | 1.5652 | 0.0182 | 0.4742 | 27 |
| 1.7185 | 0.0228 | 0.4028 | 1.5159 | 0.0184 | 0.4632 | 28 |
| 1.6401 | 0.0232 | 0.3867 | 1.4891 | 0.0185 | 0.4548 | 29 |
Framework versions
- Transformers 4.34.0.dev0
- TensorFlow 2.13.0
- Tokenizers 0.13.3
