<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
171-tiny_tobacco3482_og_simkd
This model is a fine-tuned version of WinKawaks/vit-tiny-patch16-224 on the None dataset. It achieves the following results on the evaluation set:
- Loss: 1545.9613
- Accuracy: 0.835
- Brier Loss: 0.2581
- Nll: 1.8079
- F1 Micro: 0.835
- F1 Macro: 0.8078
- Ece: 0.1626
- Aurc: 0.0552
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 100
Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Brier Loss | Nll | F1 Micro | F1 Macro | Ece | Aurc |
|---|---|---|---|---|---|---|---|---|---|---|
| No log | 1.0 | 50 | 1583.9828 | 0.195 | 0.8629 | 4.7365 | 0.195 | 0.0729 | 0.2366 | 0.5739 |
| No log | 2.0 | 100 | 1579.1852 | 0.47 | 0.7171 | 2.4638 | 0.47 | 0.3442 | 0.3084 | 0.3108 |
| No log | 3.0 | 150 | 1572.6602 | 0.625 | 0.5876 | 2.4898 | 0.625 | 0.5699 | 0.3192 | 0.1832 |
| No log | 4.0 | 200 | 1568.2220 | 0.655 | 0.5098 | 2.4424 | 0.655 | 0.5454 | 0.2498 | 0.1503 |
| No log | 5.0 | 250 | 1564.8569 | 0.72 | 0.4455 | 2.0840 | 0.72 | 0.5990 | 0.2387 | 0.1189 |
| No log | 6.0 | 300 | 1567.0118 | 0.51 | 0.6163 | 3.9029 | 0.51 | 0.4434 | 0.2623 | 0.2494 |
| No log | 7.0 | 350 | 1563.1887 | 0.745 | 0.4081 | 2.3136 | 0.745 | 0.6818 | 0.2108 | 0.1029 |
| No log | 8.0 | 400 | 1561.1106 | 0.74 | 0.4192 | 2.0321 | 0.74 | 0.6974 | 0.2351 | 0.1040 |
| No log | 9.0 | 450 | 1559.3597 | 0.665 | 0.4981 | 2.6615 | 0.665 | 0.6722 | 0.2456 | 0.1715 |
| 1524.8844 | 10.0 | 500 | 1564.1249 | 0.73 | 0.4146 | 2.2876 | 0.7300 | 0.6839 | 0.2202 | 0.0966 |
| 1524.8844 | 11.0 | 550 | 1571.7053 | 0.69 | 0.4778 | 3.9365 | 0.69 | 0.6192 | 0.2256 | 0.1386 |
| 1524.8844 | 12.0 | 600 | 1566.6997 | 0.74 | 0.3931 | 2.4325 | 0.74 | 0.6717 | 0.2158 | 0.0952 |
| 1524.8844 | 13.0 | 650 | 1563.5497 | 0.71 | 0.4268 | 3.1600 | 0.7100 | 0.6571 | 0.2277 | 0.1104 |
| 1524.8844 | 14.0 | 700 | 1554.3715 | 0.795 | 0.3309 | 2.8276 | 0.795 | 0.7856 | 0.1968 | 0.0575 |
| 1524.8844 | 15.0 | 750 | 1557.7578 | 0.83 | 0.2923 | 2.0899 | 0.83 | 0.8167 | 0.2174 | 0.0508 |
| 1524.8844 | 16.0 | 800 | 1551.9381 | 0.78 | 0.3410 | 2.2729 | 0.78 | 0.7566 | 0.1860 | 0.0857 |
| 1524.8844 | 17.0 | 850 | 1561.5450 | 0.765 | 0.3687 | 2.6934 | 0.765 | 0.7402 | 0.2318 | 0.0777 |
| 1524.8844 | 18.0 | 900 | 1561.7700 | 0.755 | 0.3746 | 2.6989 | 0.755 | 0.7246 | 0.2163 | 0.0802 |
| 1524.8844 | 19.0 | 950 | 1556.6021 | 0.78 | 0.3457 | 2.1642 | 0.78 | 0.7820 | 0.1890 | 0.0700 |
| 1511.8512 | 20.0 | 1000 | 1560.8047 | 0.745 | 0.4095 | 3.1277 | 0.745 | 0.7095 | 0.2325 | 0.1169 |
| 1511.8512 | 21.0 | 1050 | 1562.6659 | 0.82 | 0.3097 | 2.1455 | 0.82 | 0.7896 | 0.2215 | 0.0631 |
| 1511.8512 | 22.0 | 1100 | 1552.2571 | 0.795 | 0.3317 | 2.2236 | 0.795 | 0.7833 | 0.2097 | 0.0866 |
| 1511.8512 | 23.0 | 1150 | 1556.3745 | 0.815 | 0.2791 | 1.7801 | 0.815 | 0.7915 | 0.1747 | 0.0456 |
| 1511.8512 | 24.0 | 1200 | 1553.9163 | 0.835 | 0.2826 | 1.8593 | 0.835 | 0.8139 | 0.2010 | 0.0576 |
| 1511.8512 | 25.0 | 1250 | 1553.7266 | 0.835 | 0.2823 | 1.9374 | 0.835 | 0.8099 | 0.1944 | 0.0640 |
| 1511.8512 | 26.0 | 1300 | 1551.4546 | 0.83 | 0.2789 | 1.8261 | 0.83 | 0.8093 | 0.1795 | 0.0630 |
| 1511.8512 | 27.0 | 1350 | 1550.9459 | 0.84 | 0.2788 | 1.9731 | 0.8400 | 0.8213 | 0.1788 | 0.0638 |
| 1511.8512 | 28.0 | 1400 | 1554.3896 | 0.825 | 0.2678 | 1.7180 | 0.825 | 0.8069 | 0.1793 | 0.0560 |
| 1511.8512 | 29.0 | 1450 | 1550.7052 | 0.81 | 0.3100 | 1.9994 | 0.81 | 0.7942 | 0.1852 | 0.0689 |
| 1507.4645 | 30.0 | 1500 | 1552.1665 | 0.83 | 0.2807 | 1.7044 | 0.83 | 0.7991 | 0.1742 | 0.0644 |
| 1507.4645 | 31.0 | 1550 | 1544.2642 | 0.845 | 0.2619 | 1.7200 | 0.845 | 0.8219 | 0.1690 | 0.0731 |
| 1507.4645 | 32.0 | 1600 | 1548.5247 | 0.83 | 0.2698 | 1.8894 | 0.83 | 0.8061 | 0.1609 | 0.0597 |
| 1507.4645 | 33.0 | 1650 | 1543.8158 | 0.845 | 0.2641 | 1.6868 | 0.845 | 0.8348 | 0.1911 | 0.0601 |
| 1507.4645 | 34.0 | 1700 | 1550.6659 | 0.855 | 0.2562 | 1.7688 | 0.855 | 0.8349 | 0.1867 | 0.0643 |
| 1507.4645 | 35.0 | 1750 | 1552.8594 | 0.85 | 0.2560 | 1.5886 | 0.85 | 0.8338 | 0.1746 | 0.0541 |
| 1507.4645 | 36.0 | 1800 | 1550.4800 | 0.835 | 0.2620 | 1.7978 | 0.835 | 0.8217 | 0.1659 | 0.0531 |
| 1507.4645 | 37.0 | 1850 | 1548.1787 | 0.835 | 0.2700 | 1.7099 | 0.835 | 0.8122 | 0.1750 | 0.0710 |
| 1507.4645 | 38.0 | 1900 | 1550.8218 | 0.84 | 0.2601 | 1.7914 | 0.8400 | 0.8170 | 0.1637 | 0.0560 |
| 1507.4645 | 39.0 | 1950 | 1546.4485 | 0.845 | 0.2624 | 1.8862 | 0.845 | 0.8288 | 0.1672 | 0.0669 |
| 1504.6109 | 40.0 | 2000 | 1548.0247 | 0.84 | 0.2641 | 1.8206 | 0.8400 | 0.8265 | 0.1677 | 0.0574 |
| 1504.6109 | 41.0 | 2050 | 1548.5134 | 0.85 | 0.2636 | 1.8483 | 0.85 | 0.8370 | 0.1794 | 0.0536 |
| 1504.6109 | 42.0 | 2100 | 1549.4111 | 0.84 | 0.2714 | 1.8670 | 0.8400 | 0.8216 | 0.1741 | 0.0656 |
| 1504.6109 | 43.0 | 2150 | 1545.5203 | 0.855 | 0.2578 | 1.8265 | 0.855 | 0.8343 | 0.1555 | 0.0688 |
| 1504.6109 | 44.0 | 2200 | 1550.9375 | 0.835 | 0.2802 | 2.0555 | 0.835 | 0.8104 | 0.1645 | 0.0599 |
| 1504.6109 | 45.0 | 2250 | 1548.9200 | 0.85 | 0.2560 | 1.6944 | 0.85 | 0.8233 | 0.1539 | 0.0636 |
| 1504.6109 | 46.0 | 2300 | 1551.2212 | 0.835 | 0.2620 | 1.7128 | 0.835 | 0.8161 | 0.1679 | 0.0444 |
| 1504.6109 | 47.0 | 2350 | 1551.1859 | 0.84 | 0.2644 | 1.7914 | 0.8400 | 0.8255 | 0.1696 | 0.0522 |
| 1504.6109 | 48.0 | 2400 | 1549.4532 | 0.84 | 0.2629 | 1.8107 | 0.8400 | 0.8154 | 0.1651 | 0.0513 |
| 1504.6109 | 49.0 | 2450 | 1552.7788 | 0.835 | 0.2626 | 1.7638 | 0.835 | 0.8102 | 0.1767 | 0.0521 |
| 1502.7574 | 50.0 | 2500 | 1536.4287 | 0.855 | 0.2483 | 1.7998 | 0.855 | 0.8292 | 0.1589 | 0.0694 |
| 1502.7574 | 51.0 | 2550 | 1549.2762 | 0.855 | 0.2449 | 1.6393 | 0.855 | 0.8306 | 0.1829 | 0.0626 |
| 1502.7574 | 52.0 | 2600 | 1549.4481 | 0.845 | 0.2684 | 1.8626 | 0.845 | 0.8194 | 0.1674 | 0.0590 |
| 1502.7574 | 53.0 | 2650 | 1546.8684 | 0.855 | 0.2592 | 1.8554 | 0.855 | 0.8293 | 0.1681 | 0.0634 |
| 1502.7574 | 54.0 | 2700 | 1546.9109 | 0.83 | 0.2613 | 1.7866 | 0.83 | 0.8031 | 0.1627 | 0.0610 |
| 1502.7574 | 55.0 | 2750 | 1545.6719 | 0.83 | 0.2710 | 1.6850 | 0.83 | 0.8005 | 0.1635 | 0.0617 |
| 1502.7574 | 56.0 | 2800 | 1549.3009 | 0.83 | 0.2740 | 1.7925 | 0.83 | 0.8082 | 0.1739 | 0.0621 |
| 1502.7574 | 57.0 | 2850 | 1544.9680 | 0.825 | 0.2710 | 1.7718 | 0.825 | 0.7994 | 0.1725 | 0.0642 |
| 1502.7574 | 58.0 | 2900 | 1549.2238 | 0.835 | 0.2536 | 1.6798 | 0.835 | 0.8074 | 0.1711 | 0.0538 |
| 1502.7574 | 59.0 | 2950 | 1546.0543 | 0.85 | 0.2579 | 1.7481 | 0.85 | 0.8254 | 0.1719 | 0.0682 |
| 1501.0283 | 60.0 | 3000 | 1545.8566 | 0.845 | 0.2503 | 1.8351 | 0.845 | 0.8218 | 0.1598 | 0.0583 |
| 1501.0283 | 61.0 | 3050 | 1548.5146 | 0.845 | 0.2529 | 1.7119 | 0.845 | 0.8188 | 0.1609 | 0.0577 |
| 1501.0283 | 62.0 | 3100 | 1545.9747 | 0.835 | 0.2619 | 1.7379 | 0.835 | 0.8045 | 0.1545 | 0.0566 |
| 1501.0283 | 63.0 | 3150 | 1543.2375 | 0.84 | 0.2631 | 1.9799 | 0.8400 | 0.8181 | 0.1544 | 0.0701 |
| 1501.0283 | 64.0 | 3200 | 1542.9421 | 0.84 | 0.2659 | 1.8430 | 0.8400 | 0.8122 | 0.1674 | 0.0635 |
| 1501.0283 | 65.0 | 3250 | 1548.4230 | 0.855 | 0.2566 | 1.8601 | 0.855 | 0.8308 | 0.1732 | 0.0548 |
| 1501.0283 | 66.0 | 3300 | 1545.2163 | 0.835 | 0.2603 | 1.7657 | 0.835 | 0.8123 | 0.1661 | 0.0685 |
| 1501.0283 | 67.0 | 3350 | 1545.8247 | 0.835 | 0.2619 | 1.7753 | 0.835 | 0.8122 | 0.1683 | 0.0625 |
| 1501.0283 | 68.0 | 3400 | 1548.2606 | 0.845 | 0.2498 | 1.7430 | 0.845 | 0.8151 | 0.1692 | 0.0539 |
| 1501.0283 | 69.0 | 3450 | 1546.6490 | 0.85 | 0.2601 | 1.7287 | 0.85 | 0.8212 | 0.1707 | 0.0559 |
| 1499.823 | 70.0 | 3500 | 1547.7959 | 0.83 | 0.2623 | 1.7656 | 0.83 | 0.8039 | 0.1696 | 0.0606 |
| 1499.823 | 71.0 | 3550 | 1545.1508 | 0.84 | 0.2579 | 1.7362 | 0.8400 | 0.8141 | 0.1546 | 0.0587 |
| 1499.823 | 72.0 | 3600 | 1547.2922 | 0.83 | 0.2599 | 1.7354 | 0.83 | 0.8070 | 0.1609 | 0.0565 |
| 1499.823 | 73.0 | 3650 | 1547.1040 | 0.85 | 0.2556 | 1.7806 | 0.85 | 0.8271 | 0.1635 | 0.0598 |
| 1499.823 | 74.0 | 3700 | 1546.0535 | 0.83 | 0.2644 | 1.7560 | 0.83 | 0.8022 | 0.1557 | 0.0585 |
| 1499.823 | 75.0 | 3750 | 1548.1322 | 0.85 | 0.2569 | 1.7507 | 0.85 | 0.8297 | 0.1802 | 0.0559 |
| 1499.823 | 76.0 | 3800 | 1546.1481 | 0.84 | 0.2539 | 1.7530 | 0.8400 | 0.8147 | 0.1551 | 0.0572 |
| 1499.823 | 77.0 | 3850 | 1546.6122 | 0.855 | 0.2459 | 1.7644 | 0.855 | 0.8269 | 0.1687 | 0.0548 |
| 1499.823 | 78.0 | 3900 | 1550.3534 | 0.835 | 0.2651 | 1.7555 | 0.835 | 0.8085 | 0.1719 | 0.0579 |
| 1499.823 | 79.0 | 3950 | 1549.6628 | 0.85 | 0.2536 | 1.7469 | 0.85 | 0.8272 | 0.1678 | 0.0535 |
| 1499.0814 | 80.0 | 4000 | 1547.6503 | 0.85 | 0.2484 | 1.8084 | 0.85 | 0.8243 | 0.1628 | 0.0557 |
| 1499.0814 | 81.0 | 4050 | 1546.0641 | 0.855 | 0.2545 | 1.7587 | 0.855 | 0.8295 | 0.1725 | 0.0592 |
| 1499.0814 | 82.0 | 4100 | 1550.3037 | 0.83 | 0.2541 | 1.7713 | 0.83 | 0.8016 | 0.1598 | 0.0483 |
| 1499.0814 | 83.0 | 4150 | 1547.8164 | 0.85 | 0.2516 | 1.7390 | 0.85 | 0.8190 | 0.1701 | 0.0568 |
| 1499.0814 | 84.0 | 4200 | 1541.3584 | 0.84 | 0.2536 | 1.7410 | 0.8400 | 0.8165 | 0.1482 | 0.0625 |
| 1499.0814 | 85.0 | 4250 | 1546.9172 | 0.835 | 0.2577 | 1.7380 | 0.835 | 0.8089 | 0.1497 | 0.0520 |
| 1499.0814 | 86.0 | 4300 | 1548.3782 | 0.84 | 0.2591 | 1.8017 | 0.8400 | 0.8169 | 0.1655 | 0.0515 |
| 1499.0814 | 87.0 | 4350 | 1547.3690 | 0.83 | 0.2629 | 1.7771 | 0.83 | 0.8030 | 0.1591 | 0.0546 |
| 1499.0814 | 88.0 | 4400 | 1546.2750 | 0.84 | 0.2637 | 1.7430 | 0.8400 | 0.8197 | 0.1538 | 0.0529 |
| 1499.0814 | 89.0 | 4450 | 1542.7203 | 0.84 | 0.2524 | 1.8141 | 0.8400 | 0.8181 | 0.1616 | 0.0583 |
| 1498.2634 | 90.0 | 4500 | 1546.0441 | 0.84 | 0.2537 | 1.7778 | 0.8400 | 0.8111 | 0.1550 | 0.0534 |
| 1498.2634 | 91.0 | 4550 | 1549.2853 | 0.835 | 0.2646 | 1.7224 | 0.835 | 0.8093 | 0.1503 | 0.0514 |
| 1498.2634 | 92.0 | 4600 | 1547.8093 | 0.825 | 0.2631 | 1.7433 | 0.825 | 0.8052 | 0.1469 | 0.0534 |
| 1498.2634 | 93.0 | 4650 | 1547.4916 | 0.84 | 0.2608 | 1.7245 | 0.8400 | 0.8163 | 0.1615 | 0.0512 |
| 1498.2634 | 94.0 | 4700 | 1546.7931 | 0.835 | 0.2636 | 1.7105 | 0.835 | 0.8110 | 0.1640 | 0.0564 |
| 1498.2634 | 95.0 | 4750 | 1542.2678 | 0.83 | 0.2633 | 1.7869 | 0.83 | 0.8008 | 0.1528 | 0.0567 |
| 1498.2634 | 96.0 | 4800 | 1546.7603 | 0.845 | 0.2611 | 1.7291 | 0.845 | 0.8253 | 0.1671 | 0.0547 |
| 1498.2634 | 97.0 | 4850 | 1547.1423 | 0.835 | 0.2639 | 1.7659 | 0.835 | 0.8144 | 0.1608 | 0.0557 |
| 1498.2634 | 98.0 | 4900 | 1549.5010 | 0.835 | 0.2588 | 1.7856 | 0.835 | 0.8078 | 0.1637 | 0.0499 |
| 1498.2634 | 99.0 | 4950 | 1544.0619 | 0.84 | 0.2604 | 1.7604 | 0.8400 | 0.8162 | 0.1582 | 0.0560 |
| 1498.0844 | 100.0 | 5000 | 1545.9613 | 0.835 | 0.2581 | 1.8079 | 0.835 | 0.8078 | 0.1626 | 0.0552 |
Framework versions
- Transformers 4.26.1
- Pytorch 1.13.1.post200
- Datasets 2.9.0
- Tokenizers 0.13.2
