<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
114-tiny_tobacco3482_og_simkd
This model is a fine-tuned version of WinKawaks/vit-tiny-patch16-224 on the None dataset. It achieves the following results on the evaluation set:
- Loss: 1893.8862
- Accuracy: 0.81
- Brier Loss: 0.3043
- Nll: 1.7237
- F1 Micro: 0.81
- F1 Macro: 0.7986
- Ece: 0.2043
- Aurc: 0.0518
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 100
Training results
Training Loss | Epoch | Step | Validation Loss | Accuracy | Brier Loss | Nll | F1 Micro | F1 Macro | Ece | Aurc |
---|---|---|---|---|---|---|---|---|---|---|
No log | 1.0 | 50 | 1935.1045 | 0.185 | 0.8736 | 6.0686 | 0.185 | 0.0688 | 0.2403 | 0.5781 |
No log | 2.0 | 100 | 1929.4067 | 0.38 | 0.7591 | 2.7813 | 0.38 | 0.2846 | 0.2736 | 0.3992 |
No log | 3.0 | 150 | 1922.6112 | 0.52 | 0.6781 | 3.2915 | 0.52 | 0.4584 | 0.3133 | 0.2609 |
No log | 4.0 | 200 | 1915.7050 | 0.555 | 0.5833 | 2.9277 | 0.555 | 0.4448 | 0.2570 | 0.2195 |
No log | 5.0 | 250 | 1909.4652 | 0.705 | 0.4886 | 2.2512 | 0.705 | 0.5909 | 0.2891 | 0.1184 |
No log | 6.0 | 300 | 1921.1434 | 0.56 | 0.5606 | 2.8580 | 0.56 | 0.4688 | 0.2439 | 0.1803 |
No log | 7.0 | 350 | 1915.3008 | 0.68 | 0.4581 | 2.5626 | 0.68 | 0.5349 | 0.2522 | 0.1105 |
No log | 8.0 | 400 | 1910.5537 | 0.755 | 0.4383 | 2.3359 | 0.755 | 0.7020 | 0.3135 | 0.0876 |
No log | 9.0 | 450 | 1904.0891 | 0.745 | 0.4316 | 2.7111 | 0.745 | 0.7106 | 0.2586 | 0.0938 |
1805.2034 | 10.0 | 500 | 1910.0713 | 0.74 | 0.4450 | 2.5024 | 0.74 | 0.7050 | 0.2549 | 0.1025 |
1805.2034 | 11.0 | 550 | 1919.6288 | 0.645 | 0.5364 | 3.8307 | 0.645 | 0.5714 | 0.2608 | 0.1798 |
1805.2034 | 12.0 | 600 | 1906.6981 | 0.755 | 0.4213 | 2.3151 | 0.755 | 0.7259 | 0.2818 | 0.0784 |
1805.2034 | 13.0 | 650 | 1917.8431 | 0.75 | 0.4398 | 2.6290 | 0.75 | 0.6892 | 0.2979 | 0.1018 |
1805.2034 | 14.0 | 700 | 1903.4856 | 0.775 | 0.4175 | 1.9907 | 0.775 | 0.7792 | 0.2951 | 0.0818 |
1805.2034 | 15.0 | 750 | 1921.8427 | 0.65 | 0.5353 | 3.4019 | 0.65 | 0.6228 | 0.3013 | 0.1318 |
1805.2034 | 16.0 | 800 | 1909.0247 | 0.78 | 0.4072 | 2.3930 | 0.78 | 0.7669 | 0.2861 | 0.0777 |
1805.2034 | 17.0 | 850 | 1904.9219 | 0.77 | 0.4239 | 3.0975 | 0.7700 | 0.7413 | 0.2926 | 0.0850 |
1805.2034 | 18.0 | 900 | 1909.7672 | 0.795 | 0.4094 | 1.8444 | 0.795 | 0.7631 | 0.3217 | 0.0703 |
1805.2034 | 19.0 | 950 | 1902.0480 | 0.78 | 0.3774 | 2.2148 | 0.78 | 0.7783 | 0.2871 | 0.0818 |
1791.9011 | 20.0 | 1000 | 1909.4414 | 0.775 | 0.3855 | 2.1104 | 0.775 | 0.7248 | 0.2782 | 0.0678 |
1791.9011 | 21.0 | 1050 | 1908.0966 | 0.805 | 0.3740 | 2.2179 | 0.805 | 0.7927 | 0.2643 | 0.0708 |
1791.9011 | 22.0 | 1100 | 1901.1847 | 0.81 | 0.3374 | 2.0363 | 0.81 | 0.7951 | 0.2685 | 0.0482 |
1791.9011 | 23.0 | 1150 | 1906.8840 | 0.79 | 0.3623 | 2.0552 | 0.79 | 0.7541 | 0.2722 | 0.0722 |
1791.9011 | 24.0 | 1200 | 1906.2512 | 0.805 | 0.3717 | 2.1442 | 0.805 | 0.7782 | 0.2826 | 0.0673 |
1791.9011 | 25.0 | 1250 | 1907.1316 | 0.8 | 0.3593 | 2.2944 | 0.8000 | 0.7751 | 0.2603 | 0.0540 |
1791.9011 | 26.0 | 1300 | 1905.5479 | 0.81 | 0.3382 | 2.1642 | 0.81 | 0.8011 | 0.2643 | 0.0588 |
1791.9011 | 27.0 | 1350 | 1901.1903 | 0.81 | 0.3459 | 1.8076 | 0.81 | 0.8003 | 0.2701 | 0.0593 |
1791.9011 | 28.0 | 1400 | 1909.6206 | 0.775 | 0.3710 | 2.0871 | 0.775 | 0.7602 | 0.2669 | 0.0662 |
1791.9011 | 29.0 | 1450 | 1898.1127 | 0.825 | 0.3183 | 1.9650 | 0.825 | 0.8106 | 0.2453 | 0.0466 |
1787.102 | 30.0 | 1500 | 1899.2822 | 0.815 | 0.3199 | 2.0598 | 0.815 | 0.8009 | 0.2249 | 0.0535 |
1787.102 | 31.0 | 1550 | 1896.6500 | 0.815 | 0.3261 | 1.8001 | 0.815 | 0.8092 | 0.2422 | 0.0518 |
1787.102 | 32.0 | 1600 | 1895.1382 | 0.815 | 0.3185 | 1.7859 | 0.815 | 0.7927 | 0.2447 | 0.0528 |
1787.102 | 33.0 | 1650 | 1895.5653 | 0.83 | 0.3093 | 1.8941 | 0.83 | 0.8208 | 0.2492 | 0.0514 |
1787.102 | 34.0 | 1700 | 1903.5587 | 0.825 | 0.3330 | 2.0897 | 0.825 | 0.8191 | 0.2669 | 0.0564 |
1787.102 | 35.0 | 1750 | 1906.5038 | 0.79 | 0.3470 | 2.0105 | 0.79 | 0.7706 | 0.2470 | 0.0555 |
1787.102 | 36.0 | 1800 | 1900.6022 | 0.82 | 0.3315 | 1.7296 | 0.82 | 0.7975 | 0.2521 | 0.0562 |
1787.102 | 37.0 | 1850 | 1905.2075 | 0.82 | 0.3317 | 1.6814 | 0.82 | 0.8032 | 0.2497 | 0.0500 |
1787.102 | 38.0 | 1900 | 1903.8790 | 0.805 | 0.3429 | 1.7498 | 0.805 | 0.7981 | 0.2636 | 0.0551 |
1787.102 | 39.0 | 1950 | 1900.6611 | 0.815 | 0.3180 | 1.8225 | 0.815 | 0.8030 | 0.2445 | 0.0508 |
1783.8555 | 40.0 | 2000 | 1898.1110 | 0.815 | 0.3065 | 1.7107 | 0.815 | 0.7966 | 0.2119 | 0.0468 |
1783.8555 | 41.0 | 2050 | 1898.4365 | 0.83 | 0.3143 | 1.7429 | 0.83 | 0.8211 | 0.2559 | 0.0459 |
1783.8555 | 42.0 | 2100 | 1897.6564 | 0.825 | 0.3174 | 1.6802 | 0.825 | 0.8289 | 0.2337 | 0.0528 |
1783.8555 | 43.0 | 2150 | 1895.1722 | 0.83 | 0.3140 | 1.8016 | 0.83 | 0.8274 | 0.2389 | 0.0546 |
1783.8555 | 44.0 | 2200 | 1899.7227 | 0.815 | 0.3283 | 1.7356 | 0.815 | 0.8041 | 0.2357 | 0.0548 |
1783.8555 | 45.0 | 2250 | 1900.8423 | 0.815 | 0.3203 | 1.7309 | 0.815 | 0.8027 | 0.2426 | 0.0475 |
1783.8555 | 46.0 | 2300 | 1897.0514 | 0.805 | 0.3144 | 1.6915 | 0.805 | 0.7944 | 0.2256 | 0.0487 |
1783.8555 | 47.0 | 2350 | 1899.8257 | 0.82 | 0.3165 | 1.8902 | 0.82 | 0.8063 | 0.2467 | 0.0534 |
1783.8555 | 48.0 | 2400 | 1898.5613 | 0.83 | 0.3184 | 1.6568 | 0.83 | 0.8262 | 0.2501 | 0.0505 |
1783.8555 | 49.0 | 2450 | 1900.2554 | 0.815 | 0.3214 | 1.5944 | 0.815 | 0.8144 | 0.2196 | 0.0526 |
1781.6714 | 50.0 | 2500 | 1887.5803 | 0.82 | 0.3064 | 1.9301 | 0.82 | 0.8071 | 0.2161 | 0.0509 |
1781.6714 | 51.0 | 2550 | 1897.9454 | 0.8 | 0.3173 | 1.7138 | 0.8000 | 0.7864 | 0.2198 | 0.0516 |
1781.6714 | 52.0 | 2600 | 1897.1787 | 0.82 | 0.3129 | 1.7421 | 0.82 | 0.8134 | 0.2336 | 0.0484 |
1781.6714 | 53.0 | 2650 | 1894.3107 | 0.815 | 0.3074 | 1.8254 | 0.815 | 0.8044 | 0.2158 | 0.0503 |
1781.6714 | 54.0 | 2700 | 1893.0331 | 0.82 | 0.3107 | 1.8731 | 0.82 | 0.8128 | 0.2317 | 0.0510 |
1781.6714 | 55.0 | 2750 | 1891.3662 | 0.805 | 0.3096 | 1.5809 | 0.805 | 0.7907 | 0.2200 | 0.0530 |
1781.6714 | 56.0 | 2800 | 1898.0635 | 0.81 | 0.3201 | 1.8833 | 0.81 | 0.7984 | 0.2422 | 0.0527 |
1781.6714 | 57.0 | 2850 | 1893.0884 | 0.82 | 0.3090 | 1.7285 | 0.82 | 0.8109 | 0.2237 | 0.0478 |
1781.6714 | 58.0 | 2900 | 1898.0316 | 0.81 | 0.3096 | 1.7963 | 0.81 | 0.7911 | 0.2020 | 0.0500 |
1781.6714 | 59.0 | 2950 | 1894.0997 | 0.83 | 0.3112 | 1.7991 | 0.83 | 0.8258 | 0.2204 | 0.0527 |
1779.6704 | 60.0 | 3000 | 1896.0547 | 0.815 | 0.3134 | 1.7401 | 0.815 | 0.8015 | 0.2084 | 0.0573 |
1779.6704 | 61.0 | 3050 | 1895.2075 | 0.8 | 0.3155 | 1.7718 | 0.8000 | 0.7934 | 0.2166 | 0.0535 |
1779.6704 | 62.0 | 3100 | 1893.9904 | 0.82 | 0.3038 | 1.6664 | 0.82 | 0.8008 | 0.2104 | 0.0529 |
1779.6704 | 63.0 | 3150 | 1891.7444 | 0.83 | 0.3003 | 1.6876 | 0.83 | 0.8184 | 0.2047 | 0.0502 |
1779.6704 | 64.0 | 3200 | 1891.1179 | 0.825 | 0.3024 | 1.6612 | 0.825 | 0.8057 | 0.2204 | 0.0532 |
1779.6704 | 65.0 | 3250 | 1896.2891 | 0.805 | 0.3155 | 1.6865 | 0.805 | 0.7950 | 0.2164 | 0.0579 |
1779.6704 | 66.0 | 3300 | 1893.3801 | 0.82 | 0.2999 | 1.6871 | 0.82 | 0.8052 | 0.2143 | 0.0531 |
1779.6704 | 67.0 | 3350 | 1894.5913 | 0.825 | 0.3076 | 1.6609 | 0.825 | 0.8120 | 0.1837 | 0.0541 |
1779.6704 | 68.0 | 3400 | 1896.0500 | 0.82 | 0.3114 | 1.7333 | 0.82 | 0.8047 | 0.2223 | 0.0517 |
1779.6704 | 69.0 | 3450 | 1893.4884 | 0.805 | 0.3052 | 1.6768 | 0.805 | 0.7973 | 0.2042 | 0.0519 |
1778.3283 | 70.0 | 3500 | 1895.4883 | 0.815 | 0.3078 | 1.7596 | 0.815 | 0.8082 | 0.2222 | 0.0508 |
1778.3283 | 71.0 | 3550 | 1894.0317 | 0.81 | 0.3078 | 1.8215 | 0.81 | 0.7981 | 0.2106 | 0.0538 |
1778.3283 | 72.0 | 3600 | 1895.4956 | 0.815 | 0.3058 | 1.7385 | 0.815 | 0.7993 | 0.2126 | 0.0532 |
1778.3283 | 73.0 | 3650 | 1896.8766 | 0.8 | 0.3106 | 1.8469 | 0.8000 | 0.7887 | 0.2042 | 0.0557 |
1778.3283 | 74.0 | 3700 | 1893.9586 | 0.82 | 0.3104 | 1.7539 | 0.82 | 0.8027 | 0.2229 | 0.0545 |
1778.3283 | 75.0 | 3750 | 1896.0406 | 0.81 | 0.3155 | 1.7257 | 0.81 | 0.7947 | 0.2177 | 0.0576 |
1778.3283 | 76.0 | 3800 | 1895.0575 | 0.815 | 0.3115 | 1.6848 | 0.815 | 0.7940 | 0.2165 | 0.0558 |
1778.3283 | 77.0 | 3850 | 1895.8911 | 0.8 | 0.3102 | 1.7059 | 0.8000 | 0.7860 | 0.2135 | 0.0550 |
1778.3283 | 78.0 | 3900 | 1897.4371 | 0.81 | 0.3138 | 1.8054 | 0.81 | 0.7986 | 0.2218 | 0.0541 |
1778.3283 | 79.0 | 3950 | 1897.8650 | 0.805 | 0.3148 | 1.8384 | 0.805 | 0.7899 | 0.2226 | 0.0529 |
1777.483 | 80.0 | 4000 | 1896.5586 | 0.82 | 0.3121 | 1.6966 | 0.82 | 0.8040 | 0.2163 | 0.0547 |
1777.483 | 81.0 | 4050 | 1894.1078 | 0.805 | 0.3029 | 1.7155 | 0.805 | 0.7913 | 0.2053 | 0.0504 |
1777.483 | 82.0 | 4100 | 1898.5256 | 0.81 | 0.3134 | 1.7079 | 0.81 | 0.7917 | 0.2099 | 0.0546 |
1777.483 | 83.0 | 4150 | 1895.9496 | 0.8 | 0.3137 | 1.8060 | 0.8000 | 0.7837 | 0.2138 | 0.0542 |
1777.483 | 84.0 | 4200 | 1890.2460 | 0.81 | 0.3126 | 1.7942 | 0.81 | 0.7929 | 0.2040 | 0.0565 |
1777.483 | 85.0 | 4250 | 1894.1871 | 0.805 | 0.3062 | 1.8438 | 0.805 | 0.7940 | 0.1993 | 0.0514 |
1777.483 | 86.0 | 4300 | 1895.9297 | 0.81 | 0.3099 | 1.8574 | 0.81 | 0.7941 | 0.2017 | 0.0521 |
1777.483 | 87.0 | 4350 | 1894.5403 | 0.82 | 0.3044 | 1.6991 | 0.82 | 0.8036 | 0.2360 | 0.0523 |
1777.483 | 88.0 | 4400 | 1893.5771 | 0.815 | 0.3056 | 1.7819 | 0.815 | 0.7949 | 0.2241 | 0.0531 |
1777.483 | 89.0 | 4450 | 1890.9475 | 0.8 | 0.3060 | 1.7981 | 0.8000 | 0.7852 | 0.2025 | 0.0544 |
1776.5495 | 90.0 | 4500 | 1893.1115 | 0.82 | 0.3018 | 1.9212 | 0.82 | 0.8066 | 0.1983 | 0.0520 |
1776.5495 | 91.0 | 4550 | 1897.0479 | 0.815 | 0.3124 | 1.8394 | 0.815 | 0.7950 | 0.2129 | 0.0544 |
1776.5495 | 92.0 | 4600 | 1895.9264 | 0.815 | 0.3075 | 1.8241 | 0.815 | 0.8003 | 0.2220 | 0.0517 |
1776.5495 | 93.0 | 4650 | 1894.7333 | 0.805 | 0.3077 | 1.8649 | 0.805 | 0.7835 | 0.2071 | 0.0523 |
1776.5495 | 94.0 | 4700 | 1894.5804 | 0.805 | 0.3086 | 1.8344 | 0.805 | 0.7857 | 0.1945 | 0.0533 |
1776.5495 | 95.0 | 4750 | 1889.6356 | 0.805 | 0.2979 | 1.7220 | 0.805 | 0.7944 | 0.1813 | 0.0532 |
1776.5495 | 96.0 | 4800 | 1894.5663 | 0.805 | 0.3077 | 1.7782 | 0.805 | 0.7902 | 0.2031 | 0.0525 |
1776.5495 | 97.0 | 4850 | 1894.6851 | 0.815 | 0.3085 | 1.8374 | 0.815 | 0.7972 | 0.2140 | 0.0541 |
1776.5495 | 98.0 | 4900 | 1897.3888 | 0.805 | 0.3111 | 1.8603 | 0.805 | 0.7905 | 0.2092 | 0.0537 |
1776.5495 | 99.0 | 4950 | 1892.2825 | 0.815 | 0.3038 | 1.8404 | 0.815 | 0.8017 | 0.2080 | 0.0514 |
1776.3791 | 100.0 | 5000 | 1893.8862 | 0.81 | 0.3043 | 1.7237 | 0.81 | 0.7986 | 0.2043 | 0.0518 |
Framework versions
- Transformers 4.26.1
- Pytorch 1.13.1.post200
- Datasets 2.9.0
- Tokenizers 0.13.2