<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
vit-small_tobacco3482_kd_NKD_t1.0_g1.5
This model is a fine-tuned version of WinKawaks/vit-small-patch16-224 on the None dataset. It achieves the following results on the evaluation set:
- Loss: 3.9399
- Accuracy: 0.82
- Brier Loss: 0.3024
- Nll: 1.1952
- F1 Micro: 0.82
- F1 Macro: 0.7964
- Ece: 0.1494
- Aurc: 0.0548
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 128
- eval_batch_size: 128
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 100
Training results
Training Loss | Epoch | Step | Validation Loss | Accuracy | Brier Loss | Nll | F1 Micro | F1 Macro | Ece | Aurc |
---|---|---|---|---|---|---|---|---|---|---|
No log | 1.0 | 7 | 4.9730 | 0.205 | 0.8886 | 5.4337 | 0.205 | 0.1356 | 0.2736 | 0.7527 |
No log | 2.0 | 14 | 4.6039 | 0.355 | 0.8122 | 3.5880 | 0.3550 | 0.2120 | 0.3197 | 0.5132 |
No log | 3.0 | 21 | 4.2754 | 0.515 | 0.7054 | 2.0283 | 0.515 | 0.4046 | 0.3275 | 0.2966 |
No log | 4.0 | 28 | 4.0263 | 0.6 | 0.5799 | 1.5709 | 0.6 | 0.5157 | 0.3062 | 0.1890 |
No log | 5.0 | 35 | 3.8749 | 0.725 | 0.4857 | 1.5338 | 0.7250 | 0.6949 | 0.3181 | 0.1194 |
No log | 6.0 | 42 | 3.7023 | 0.765 | 0.3925 | 1.2926 | 0.765 | 0.6948 | 0.2394 | 0.0908 |
No log | 7.0 | 49 | 3.7728 | 0.78 | 0.3668 | 1.3007 | 0.78 | 0.7355 | 0.2478 | 0.0754 |
No log | 8.0 | 56 | 3.7328 | 0.785 | 0.3459 | 1.2487 | 0.785 | 0.7501 | 0.2261 | 0.0804 |
No log | 9.0 | 63 | 3.7092 | 0.77 | 0.3289 | 1.0921 | 0.7700 | 0.7672 | 0.2019 | 0.0767 |
No log | 10.0 | 70 | 3.6273 | 0.795 | 0.3150 | 1.0342 | 0.795 | 0.7690 | 0.1927 | 0.0716 |
No log | 11.0 | 77 | 3.5677 | 0.83 | 0.2754 | 1.3837 | 0.83 | 0.7933 | 0.1697 | 0.0532 |
No log | 12.0 | 84 | 3.5668 | 0.815 | 0.2816 | 1.1304 | 0.815 | 0.7934 | 0.1563 | 0.0617 |
No log | 13.0 | 91 | 3.6080 | 0.83 | 0.2723 | 0.9515 | 0.83 | 0.8088 | 0.1648 | 0.0543 |
No log | 14.0 | 98 | 3.6095 | 0.815 | 0.3050 | 1.2020 | 0.815 | 0.8207 | 0.1523 | 0.0633 |
No log | 15.0 | 105 | 3.6685 | 0.805 | 0.3060 | 1.2725 | 0.805 | 0.7920 | 0.1618 | 0.0676 |
No log | 16.0 | 112 | 3.5523 | 0.825 | 0.2832 | 0.9447 | 0.825 | 0.8163 | 0.1614 | 0.0569 |
No log | 17.0 | 119 | 3.5294 | 0.805 | 0.2752 | 0.9918 | 0.805 | 0.7636 | 0.1537 | 0.0549 |
No log | 18.0 | 126 | 3.5382 | 0.8 | 0.2870 | 1.2294 | 0.8000 | 0.7885 | 0.1603 | 0.0583 |
No log | 19.0 | 133 | 3.5541 | 0.82 | 0.2905 | 1.2181 | 0.82 | 0.8204 | 0.1400 | 0.0618 |
No log | 20.0 | 140 | 3.4717 | 0.835 | 0.2606 | 1.1119 | 0.835 | 0.8146 | 0.1382 | 0.0531 |
No log | 21.0 | 147 | 3.6074 | 0.79 | 0.3099 | 1.2144 | 0.79 | 0.7771 | 0.1419 | 0.0599 |
No log | 22.0 | 154 | 3.5448 | 0.805 | 0.2868 | 1.2075 | 0.805 | 0.7761 | 0.1439 | 0.0581 |
No log | 23.0 | 161 | 3.6070 | 0.805 | 0.3057 | 1.2908 | 0.805 | 0.7831 | 0.1393 | 0.0627 |
No log | 24.0 | 168 | 3.5289 | 0.81 | 0.2716 | 1.1844 | 0.81 | 0.7879 | 0.1358 | 0.0550 |
No log | 25.0 | 175 | 3.5502 | 0.82 | 0.2827 | 1.1141 | 0.82 | 0.7908 | 0.1460 | 0.0554 |
No log | 26.0 | 182 | 3.5747 | 0.82 | 0.2829 | 1.1727 | 0.82 | 0.8027 | 0.1330 | 0.0565 |
No log | 27.0 | 189 | 3.6091 | 0.83 | 0.2787 | 1.1040 | 0.83 | 0.8067 | 0.1347 | 0.0563 |
No log | 28.0 | 196 | 3.5917 | 0.82 | 0.2837 | 1.1775 | 0.82 | 0.7975 | 0.1513 | 0.0564 |
No log | 29.0 | 203 | 3.6087 | 0.815 | 0.2875 | 1.1448 | 0.815 | 0.7998 | 0.1339 | 0.0542 |
No log | 30.0 | 210 | 3.6018 | 0.815 | 0.2819 | 1.1613 | 0.815 | 0.8027 | 0.1507 | 0.0535 |
No log | 31.0 | 217 | 3.6350 | 0.815 | 0.2845 | 1.2278 | 0.815 | 0.7866 | 0.1401 | 0.0537 |
No log | 32.0 | 224 | 3.6290 | 0.82 | 0.2815 | 1.1528 | 0.82 | 0.7950 | 0.1424 | 0.0520 |
No log | 33.0 | 231 | 3.6642 | 0.815 | 0.2865 | 1.1504 | 0.815 | 0.7946 | 0.1379 | 0.0542 |
No log | 34.0 | 238 | 3.6778 | 0.815 | 0.2929 | 1.2116 | 0.815 | 0.7890 | 0.1437 | 0.0538 |
No log | 35.0 | 245 | 3.6867 | 0.82 | 0.2869 | 1.1547 | 0.82 | 0.7904 | 0.1404 | 0.0529 |
No log | 36.0 | 252 | 3.6931 | 0.795 | 0.2946 | 1.1478 | 0.795 | 0.7694 | 0.1494 | 0.0543 |
No log | 37.0 | 259 | 3.7166 | 0.82 | 0.2921 | 1.2109 | 0.82 | 0.7904 | 0.1489 | 0.0534 |
No log | 38.0 | 266 | 3.7024 | 0.81 | 0.2889 | 1.1516 | 0.81 | 0.7888 | 0.1508 | 0.0536 |
No log | 39.0 | 273 | 3.7353 | 0.81 | 0.2943 | 1.2088 | 0.81 | 0.7812 | 0.1466 | 0.0537 |
No log | 40.0 | 280 | 3.7198 | 0.82 | 0.2891 | 1.1515 | 0.82 | 0.8014 | 0.1285 | 0.0536 |
No log | 41.0 | 287 | 3.7413 | 0.815 | 0.2899 | 1.2124 | 0.815 | 0.7959 | 0.1471 | 0.0537 |
No log | 42.0 | 294 | 3.7272 | 0.82 | 0.2896 | 1.2071 | 0.82 | 0.8002 | 0.1414 | 0.0532 |
No log | 43.0 | 301 | 3.7609 | 0.815 | 0.2925 | 1.2100 | 0.815 | 0.7868 | 0.1486 | 0.0528 |
No log | 44.0 | 308 | 3.7589 | 0.815 | 0.2922 | 1.2074 | 0.815 | 0.7877 | 0.1398 | 0.0537 |
No log | 45.0 | 315 | 3.7820 | 0.815 | 0.2961 | 1.2078 | 0.815 | 0.7874 | 0.1499 | 0.0535 |
No log | 46.0 | 322 | 3.7663 | 0.82 | 0.2926 | 1.2053 | 0.82 | 0.8014 | 0.1369 | 0.0532 |
No log | 47.0 | 329 | 3.7850 | 0.82 | 0.2944 | 1.2079 | 0.82 | 0.7904 | 0.1374 | 0.0532 |
No log | 48.0 | 336 | 3.7802 | 0.82 | 0.2935 | 1.2025 | 0.82 | 0.7981 | 0.1483 | 0.0537 |
No log | 49.0 | 343 | 3.7954 | 0.82 | 0.2937 | 1.2068 | 0.82 | 0.7900 | 0.1354 | 0.0528 |
No log | 50.0 | 350 | 3.7974 | 0.815 | 0.2954 | 1.2020 | 0.815 | 0.7907 | 0.1491 | 0.0534 |
No log | 51.0 | 357 | 3.8081 | 0.815 | 0.2965 | 1.2035 | 0.815 | 0.7907 | 0.1533 | 0.0533 |
No log | 52.0 | 364 | 3.8171 | 0.815 | 0.2982 | 1.2033 | 0.815 | 0.7907 | 0.1466 | 0.0537 |
No log | 53.0 | 371 | 3.8136 | 0.815 | 0.2961 | 1.2035 | 0.815 | 0.7907 | 0.1399 | 0.0531 |
No log | 54.0 | 378 | 3.8244 | 0.815 | 0.2977 | 1.2024 | 0.815 | 0.7907 | 0.1586 | 0.0538 |
No log | 55.0 | 385 | 3.8265 | 0.815 | 0.2963 | 1.2004 | 0.815 | 0.7907 | 0.1506 | 0.0537 |
No log | 56.0 | 392 | 3.8376 | 0.82 | 0.2980 | 1.2011 | 0.82 | 0.7964 | 0.1471 | 0.0536 |
No log | 57.0 | 399 | 3.8428 | 0.82 | 0.2982 | 1.1994 | 0.82 | 0.7964 | 0.1562 | 0.0535 |
No log | 58.0 | 406 | 3.8418 | 0.82 | 0.2973 | 1.2004 | 0.82 | 0.7964 | 0.1484 | 0.0537 |
No log | 59.0 | 413 | 3.8507 | 0.82 | 0.2984 | 1.2009 | 0.82 | 0.7931 | 0.1563 | 0.0538 |
No log | 60.0 | 420 | 3.8560 | 0.82 | 0.2989 | 1.2001 | 0.82 | 0.7964 | 0.1579 | 0.0540 |
No log | 61.0 | 427 | 3.8563 | 0.82 | 0.2974 | 1.1997 | 0.82 | 0.7964 | 0.1560 | 0.0536 |
No log | 62.0 | 434 | 3.8648 | 0.815 | 0.2986 | 1.1995 | 0.815 | 0.7907 | 0.1532 | 0.0540 |
No log | 63.0 | 441 | 3.8682 | 0.82 | 0.2991 | 1.1991 | 0.82 | 0.7964 | 0.1570 | 0.0536 |
No log | 64.0 | 448 | 3.8735 | 0.82 | 0.2989 | 1.1984 | 0.82 | 0.7964 | 0.1481 | 0.0539 |
No log | 65.0 | 455 | 3.8794 | 0.82 | 0.3000 | 1.1981 | 0.82 | 0.7964 | 0.1496 | 0.0543 |
No log | 66.0 | 462 | 3.8824 | 0.82 | 0.3002 | 1.1980 | 0.82 | 0.7964 | 0.1567 | 0.0539 |
No log | 67.0 | 469 | 3.8842 | 0.82 | 0.3005 | 1.1983 | 0.82 | 0.7964 | 0.1438 | 0.0542 |
No log | 68.0 | 476 | 3.8866 | 0.82 | 0.3001 | 1.1978 | 0.82 | 0.7964 | 0.1418 | 0.0540 |
No log | 69.0 | 483 | 3.8912 | 0.82 | 0.3003 | 1.1977 | 0.82 | 0.7964 | 0.1570 | 0.0541 |
No log | 70.0 | 490 | 3.8959 | 0.82 | 0.3008 | 1.1971 | 0.82 | 0.7964 | 0.1445 | 0.0544 |
No log | 71.0 | 497 | 3.8964 | 0.82 | 0.3002 | 1.1977 | 0.82 | 0.7964 | 0.1366 | 0.0543 |
3.4649 | 72.0 | 504 | 3.9021 | 0.82 | 0.3009 | 1.1969 | 0.82 | 0.7964 | 0.1471 | 0.0543 |
3.4649 | 73.0 | 511 | 3.9052 | 0.82 | 0.3015 | 1.1976 | 0.82 | 0.7964 | 0.1532 | 0.0546 |
3.4649 | 74.0 | 518 | 3.9043 | 0.82 | 0.3002 | 1.1973 | 0.82 | 0.7964 | 0.1371 | 0.0544 |
3.4649 | 75.0 | 525 | 3.9096 | 0.82 | 0.3004 | 1.1966 | 0.82 | 0.7964 | 0.1417 | 0.0543 |
3.4649 | 76.0 | 532 | 3.9099 | 0.82 | 0.3010 | 1.1965 | 0.82 | 0.7964 | 0.1428 | 0.0545 |
3.4649 | 77.0 | 539 | 3.9151 | 0.82 | 0.3016 | 1.1963 | 0.82 | 0.7964 | 0.1460 | 0.0548 |
3.4649 | 78.0 | 546 | 3.9143 | 0.82 | 0.3010 | 1.1970 | 0.82 | 0.7964 | 0.1447 | 0.0543 |
3.4649 | 79.0 | 553 | 3.9164 | 0.82 | 0.3014 | 1.1966 | 0.82 | 0.7964 | 0.1436 | 0.0545 |
3.4649 | 80.0 | 560 | 3.9198 | 0.82 | 0.3018 | 1.1965 | 0.82 | 0.7964 | 0.1520 | 0.0545 |
3.4649 | 81.0 | 567 | 3.9218 | 0.82 | 0.3015 | 1.1959 | 0.82 | 0.7964 | 0.1440 | 0.0546 |
3.4649 | 82.0 | 574 | 3.9236 | 0.82 | 0.3018 | 1.1961 | 0.82 | 0.7964 | 0.1439 | 0.0546 |
3.4649 | 83.0 | 581 | 3.9248 | 0.82 | 0.3017 | 1.1959 | 0.82 | 0.7964 | 0.1440 | 0.0546 |
3.4649 | 84.0 | 588 | 3.9267 | 0.82 | 0.3018 | 1.1958 | 0.82 | 0.7964 | 0.1442 | 0.0545 |
3.4649 | 85.0 | 595 | 3.9286 | 0.82 | 0.3019 | 1.1959 | 0.82 | 0.7964 | 0.1443 | 0.0546 |
3.4649 | 86.0 | 602 | 3.9300 | 0.82 | 0.3020 | 1.1958 | 0.82 | 0.7964 | 0.1444 | 0.0545 |
3.4649 | 87.0 | 609 | 3.9320 | 0.82 | 0.3022 | 1.1956 | 0.82 | 0.7964 | 0.1446 | 0.0546 |
3.4649 | 88.0 | 616 | 3.9327 | 0.82 | 0.3022 | 1.1957 | 0.82 | 0.7964 | 0.1446 | 0.0545 |
3.4649 | 89.0 | 623 | 3.9340 | 0.82 | 0.3022 | 1.1955 | 0.82 | 0.7964 | 0.1436 | 0.0546 |
3.4649 | 90.0 | 630 | 3.9346 | 0.82 | 0.3022 | 1.1956 | 0.82 | 0.7964 | 0.1447 | 0.0546 |
3.4649 | 91.0 | 637 | 3.9360 | 0.82 | 0.3023 | 1.1953 | 0.82 | 0.7964 | 0.1438 | 0.0546 |
3.4649 | 92.0 | 644 | 3.9368 | 0.82 | 0.3023 | 1.1954 | 0.82 | 0.7964 | 0.1438 | 0.0546 |
3.4649 | 93.0 | 651 | 3.9374 | 0.82 | 0.3023 | 1.1954 | 0.82 | 0.7964 | 0.1437 | 0.0548 |
3.4649 | 94.0 | 658 | 3.9380 | 0.82 | 0.3023 | 1.1953 | 0.82 | 0.7964 | 0.1438 | 0.0548 |
3.4649 | 95.0 | 665 | 3.9385 | 0.82 | 0.3023 | 1.1953 | 0.82 | 0.7964 | 0.1494 | 0.0549 |
3.4649 | 96.0 | 672 | 3.9391 | 0.82 | 0.3024 | 1.1952 | 0.82 | 0.7964 | 0.1494 | 0.0548 |
3.4649 | 97.0 | 679 | 3.9393 | 0.82 | 0.3024 | 1.1952 | 0.82 | 0.7964 | 0.1495 | 0.0548 |
3.4649 | 98.0 | 686 | 3.9396 | 0.82 | 0.3024 | 1.1952 | 0.82 | 0.7964 | 0.1494 | 0.0548 |
3.4649 | 99.0 | 693 | 3.9398 | 0.82 | 0.3024 | 1.1952 | 0.82 | 0.7964 | 0.1494 | 0.0548 |
3.4649 | 100.0 | 700 | 3.9399 | 0.82 | 0.3024 | 1.1952 | 0.82 | 0.7964 | 0.1494 | 0.0548 |
Framework versions
- Transformers 4.26.1
- Pytorch 1.13.1.post200
- Datasets 2.9.0
- Tokenizers 0.13.2