<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
segformer-b0-finetuned-neurosymbolic-contingency-bag1-v0.2-v1
This model is a fine-tuned version of nvidia/mit-b0 on the sam1120/neurosymbolic-contingency-bag1_v0.2 dataset. It achieves the following results on the evaluation set:
- Loss: 0.0656
- Mean Iou: 0.8606
- Mean Accuracy: 0.9137
- Overall Accuracy: 0.9935
- Accuracy Unlabeled: nan
- Accuracy Safe: 0.8303
- Accuracy Unsafe: 0.9970
- Iou Unlabeled: nan
- Iou Safe: 0.7278
- Iou Unsafe: 0.9934
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0005552
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: polynomial
- lr_scheduler_warmup_ratio: 0.05
- num_epochs: 1400
Training results
Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unlabeled | Accuracy Safe | Accuracy Unsafe | Iou Unlabeled | Iou Safe | Iou Unsafe |
---|---|---|---|---|---|---|---|---|---|---|---|---|
0.7077 | 5.71 | 40 | 0.6235 | 0.4560 | 0.8510 | 0.9766 | nan | 0.7199 | 0.9821 | 0.0 | 0.3919 | 0.9762 |
0.3473 | 11.43 | 80 | 0.3172 | 0.4885 | 0.7734 | 0.9874 | nan | 0.5500 | 0.9968 | 0.0 | 0.4782 | 0.9873 |
0.1804 | 17.14 | 120 | 0.1714 | 0.7542 | 0.7842 | 0.9889 | nan | 0.5705 | 0.9979 | nan | 0.5196 | 0.9888 |
0.0773 | 22.86 | 160 | 0.0778 | 0.8056 | 0.8405 | 0.9912 | nan | 0.6832 | 0.9978 | nan | 0.6201 | 0.9911 |
0.0408 | 28.57 | 200 | 0.0499 | 0.8118 | 0.8494 | 0.9914 | nan | 0.7012 | 0.9977 | nan | 0.6322 | 0.9913 |
0.0319 | 34.29 | 240 | 0.0486 | 0.8121 | 0.8758 | 0.9908 | nan | 0.7557 | 0.9959 | nan | 0.6336 | 0.9907 |
0.0208 | 40.0 | 280 | 0.0337 | 0.8252 | 0.8508 | 0.9923 | nan | 0.7031 | 0.9985 | nan | 0.6582 | 0.9922 |
0.0156 | 45.71 | 320 | 0.0328 | 0.8240 | 0.8674 | 0.9919 | nan | 0.7375 | 0.9973 | nan | 0.6562 | 0.9918 |
0.0174 | 51.43 | 360 | 0.0270 | 0.8438 | 0.8577 | 0.9934 | nan | 0.7160 | 0.9993 | nan | 0.6943 | 0.9933 |
0.0122 | 57.14 | 400 | 0.0302 | 0.8370 | 0.8820 | 0.9925 | nan | 0.7666 | 0.9973 | nan | 0.6817 | 0.9924 |
0.0106 | 62.86 | 440 | 0.0301 | 0.8273 | 0.8951 | 0.9915 | nan | 0.7945 | 0.9958 | nan | 0.6631 | 0.9914 |
0.0101 | 68.57 | 480 | 0.0335 | 0.8255 | 0.8839 | 0.9916 | nan | 0.7714 | 0.9964 | nan | 0.6595 | 0.9915 |
0.0085 | 74.29 | 520 | 0.0264 | 0.8503 | 0.8794 | 0.9934 | nan | 0.7604 | 0.9984 | nan | 0.7073 | 0.9933 |
0.0096 | 80.0 | 560 | 0.0287 | 0.8575 | 0.8791 | 0.9938 | nan | 0.7593 | 0.9989 | nan | 0.7213 | 0.9937 |
0.0117 | 85.71 | 600 | 0.0305 | 0.8034 | 0.8376 | 0.9911 | nan | 0.6773 | 0.9979 | nan | 0.6158 | 0.9910 |
0.0156 | 91.43 | 640 | 0.0338 | 0.8134 | 0.9078 | 0.9902 | nan | 0.8219 | 0.9938 | nan | 0.6367 | 0.9900 |
0.0165 | 97.14 | 680 | 0.0358 | 0.8127 | 0.9149 | 0.9899 | nan | 0.8367 | 0.9932 | nan | 0.6357 | 0.9898 |
0.0083 | 102.86 | 720 | 0.0291 | 0.8383 | 0.8875 | 0.9925 | nan | 0.7780 | 0.9971 | nan | 0.6842 | 0.9923 |
0.0068 | 108.57 | 760 | 0.0290 | 0.8478 | 0.8930 | 0.9930 | nan | 0.7885 | 0.9974 | nan | 0.7026 | 0.9929 |
0.0065 | 114.29 | 800 | 0.0376 | 0.8333 | 0.8979 | 0.9919 | nan | 0.7997 | 0.9960 | nan | 0.6748 | 0.9918 |
0.0072 | 120.0 | 840 | 0.0391 | 0.8354 | 0.9087 | 0.9919 | nan | 0.8220 | 0.9955 | nan | 0.6791 | 0.9917 |
0.0065 | 125.71 | 880 | 0.0396 | 0.8386 | 0.9126 | 0.9920 | nan | 0.8298 | 0.9955 | nan | 0.6853 | 0.9919 |
0.0061 | 131.43 | 920 | 0.0392 | 0.8355 | 0.9041 | 0.9920 | nan | 0.8124 | 0.9958 | nan | 0.6792 | 0.9918 |
0.0056 | 137.14 | 960 | 0.0405 | 0.8308 | 0.8946 | 0.9918 | nan | 0.7932 | 0.9961 | nan | 0.6700 | 0.9917 |
0.0048 | 142.86 | 1000 | 0.0425 | 0.8344 | 0.9082 | 0.9918 | nan | 0.8209 | 0.9955 | nan | 0.6771 | 0.9916 |
0.0053 | 148.57 | 1040 | 0.0399 | 0.8312 | 0.8879 | 0.9920 | nan | 0.7793 | 0.9965 | nan | 0.6706 | 0.9918 |
0.0048 | 154.29 | 1080 | 0.0399 | 0.8346 | 0.8968 | 0.9920 | nan | 0.7973 | 0.9962 | nan | 0.6773 | 0.9919 |
0.004 | 160.0 | 1120 | 0.0438 | 0.8340 | 0.9013 | 0.9919 | nan | 0.8067 | 0.9959 | nan | 0.6763 | 0.9918 |
0.0064 | 165.71 | 1160 | 0.0423 | 0.8334 | 0.9029 | 0.9918 | nan | 0.8100 | 0.9957 | nan | 0.6750 | 0.9917 |
0.0086 | 171.43 | 1200 | 0.0331 | 0.8443 | 0.8785 | 0.9930 | nan | 0.7590 | 0.9981 | nan | 0.6958 | 0.9929 |
0.0061 | 177.14 | 1240 | 0.0353 | 0.8304 | 0.8910 | 0.9919 | nan | 0.7857 | 0.9963 | nan | 0.6691 | 0.9917 |
0.011 | 182.86 | 1280 | 0.0292 | 0.8246 | 0.8712 | 0.9919 | nan | 0.7452 | 0.9971 | nan | 0.6575 | 0.9917 |
0.0085 | 188.57 | 1320 | 0.0345 | 0.8190 | 0.9239 | 0.9903 | nan | 0.8546 | 0.9932 | nan | 0.6479 | 0.9901 |
0.0074 | 194.29 | 1360 | 0.0365 | 0.8307 | 0.8961 | 0.9918 | nan | 0.7962 | 0.9960 | nan | 0.6699 | 0.9916 |
0.0057 | 200.0 | 1400 | 0.0372 | 0.8340 | 0.9100 | 0.9917 | nan | 0.8247 | 0.9953 | nan | 0.6764 | 0.9916 |
0.0047 | 205.71 | 1440 | 0.0395 | 0.8380 | 0.9124 | 0.9920 | nan | 0.8294 | 0.9955 | nan | 0.6842 | 0.9918 |
0.0049 | 211.43 | 1480 | 0.0402 | 0.8356 | 0.9036 | 0.9920 | nan | 0.8113 | 0.9958 | nan | 0.6794 | 0.9918 |
0.004 | 217.14 | 1520 | 0.0396 | 0.8382 | 0.9085 | 0.9921 | nan | 0.8213 | 0.9957 | nan | 0.6844 | 0.9919 |
0.005 | 222.86 | 1560 | 0.0414 | 0.8346 | 0.8997 | 0.9920 | nan | 0.8034 | 0.9960 | nan | 0.6774 | 0.9918 |
0.0036 | 228.57 | 1600 | 0.0425 | 0.8373 | 0.9064 | 0.9920 | nan | 0.8171 | 0.9958 | nan | 0.6827 | 0.9919 |
0.0056 | 234.29 | 1640 | 0.0421 | 0.8223 | 0.8868 | 0.9913 | nan | 0.7777 | 0.9959 | nan | 0.6534 | 0.9912 |
0.0062 | 240.0 | 1680 | 0.0370 | 0.8117 | 0.8879 | 0.9905 | nan | 0.7809 | 0.9950 | nan | 0.6330 | 0.9903 |
0.0048 | 245.71 | 1720 | 0.0411 | 0.8223 | 0.9183 | 0.9907 | nan | 0.8428 | 0.9938 | nan | 0.6541 | 0.9905 |
0.0048 | 251.43 | 1760 | 0.0324 | 0.8256 | 0.8918 | 0.9915 | nan | 0.7878 | 0.9959 | nan | 0.6599 | 0.9913 |
0.0052 | 257.14 | 1800 | 0.0351 | 0.8331 | 0.8973 | 0.9919 | nan | 0.7986 | 0.9961 | nan | 0.6744 | 0.9918 |
0.0038 | 262.86 | 1840 | 0.0370 | 0.8337 | 0.9013 | 0.9919 | nan | 0.8067 | 0.9958 | nan | 0.6756 | 0.9917 |
0.0043 | 268.57 | 1880 | 0.0372 | 0.8360 | 0.9042 | 0.9920 | nan | 0.8125 | 0.9958 | nan | 0.6802 | 0.9918 |
0.0033 | 274.29 | 1920 | 0.0403 | 0.8343 | 0.8938 | 0.9921 | nan | 0.7913 | 0.9964 | nan | 0.6767 | 0.9919 |
0.0045 | 280.0 | 1960 | 0.0378 | 0.8428 | 0.9064 | 0.9924 | nan | 0.8165 | 0.9962 | nan | 0.6932 | 0.9923 |
0.0036 | 285.71 | 2000 | 0.0380 | 0.8492 | 0.8954 | 0.9931 | nan | 0.7935 | 0.9973 | nan | 0.7055 | 0.9929 |
0.0033 | 291.43 | 2040 | 0.0401 | 0.8372 | 0.9001 | 0.9921 | nan | 0.8041 | 0.9962 | nan | 0.6823 | 0.9920 |
0.004 | 297.14 | 2080 | 0.0457 | 0.8229 | 0.8930 | 0.9913 | nan | 0.7904 | 0.9956 | nan | 0.6546 | 0.9911 |
0.0044 | 302.86 | 2120 | 0.0456 | 0.8279 | 0.9048 | 0.9914 | nan | 0.8144 | 0.9952 | nan | 0.6646 | 0.9912 |
0.0033 | 308.57 | 2160 | 0.0455 | 0.8304 | 0.9059 | 0.9915 | nan | 0.8166 | 0.9953 | nan | 0.6694 | 0.9914 |
0.0031 | 314.29 | 2200 | 0.0460 | 0.8312 | 0.9065 | 0.9916 | nan | 0.8176 | 0.9953 | nan | 0.6710 | 0.9914 |
0.0031 | 320.0 | 2240 | 0.0441 | 0.8373 | 0.9043 | 0.9921 | nan | 0.8128 | 0.9959 | nan | 0.6826 | 0.9919 |
0.0033 | 325.71 | 2280 | 0.0458 | 0.8365 | 0.9080 | 0.9919 | nan | 0.8203 | 0.9956 | nan | 0.6812 | 0.9918 |
0.0028 | 331.43 | 2320 | 0.0467 | 0.8346 | 0.9074 | 0.9918 | nan | 0.8194 | 0.9955 | nan | 0.6775 | 0.9917 |
0.0032 | 337.14 | 2360 | 0.0472 | 0.8363 | 0.9082 | 0.9919 | nan | 0.8208 | 0.9956 | nan | 0.6808 | 0.9918 |
0.0026 | 342.86 | 2400 | 0.0491 | 0.8299 | 0.9032 | 0.9916 | nan | 0.8110 | 0.9954 | nan | 0.6685 | 0.9914 |
0.0031 | 348.57 | 2440 | 0.0457 | 0.8395 | 0.9030 | 0.9923 | nan | 0.8097 | 0.9962 | nan | 0.6868 | 0.9921 |
0.0034 | 354.29 | 2480 | 0.0469 | 0.8404 | 0.9053 | 0.9923 | nan | 0.8146 | 0.9961 | nan | 0.6886 | 0.9921 |
0.0026 | 360.0 | 2520 | 0.0481 | 0.8400 | 0.9052 | 0.9923 | nan | 0.8143 | 0.9961 | nan | 0.6879 | 0.9921 |
0.0028 | 365.71 | 2560 | 0.0466 | 0.8409 | 0.9103 | 0.9922 | nan | 0.8248 | 0.9958 | nan | 0.6898 | 0.9921 |
0.0028 | 371.43 | 2600 | 0.0498 | 0.8397 | 0.9034 | 0.9923 | nan | 0.8107 | 0.9962 | nan | 0.6872 | 0.9921 |
0.0026 | 377.14 | 2640 | 0.0491 | 0.8381 | 0.9111 | 0.9920 | nan | 0.8266 | 0.9955 | nan | 0.6843 | 0.9919 |
0.0025 | 382.86 | 2680 | 0.0493 | 0.8388 | 0.9075 | 0.9921 | nan | 0.8192 | 0.9958 | nan | 0.6857 | 0.9920 |
0.0051 | 388.57 | 2720 | 0.0499 | 0.8306 | 0.9155 | 0.9914 | nan | 0.8363 | 0.9947 | nan | 0.6700 | 0.9912 |
0.003 | 394.29 | 2760 | 0.0485 | 0.8378 | 0.9086 | 0.9920 | nan | 0.8215 | 0.9957 | nan | 0.6837 | 0.9919 |
0.0024 | 400.0 | 2800 | 0.0497 | 0.8403 | 0.9064 | 0.9922 | nan | 0.8169 | 0.9960 | nan | 0.6885 | 0.9921 |
0.0029 | 405.71 | 2840 | 0.0503 | 0.8427 | 0.9123 | 0.9923 | nan | 0.8288 | 0.9958 | nan | 0.6932 | 0.9922 |
0.0027 | 411.43 | 2880 | 0.0526 | 0.8408 | 0.9161 | 0.9921 | nan | 0.8367 | 0.9954 | nan | 0.6896 | 0.9920 |
0.0026 | 417.14 | 2920 | 0.0521 | 0.8410 | 0.9089 | 0.9923 | nan | 0.8220 | 0.9959 | nan | 0.6899 | 0.9921 |
0.0025 | 422.86 | 2960 | 0.0539 | 0.8425 | 0.9169 | 0.9922 | nan | 0.8384 | 0.9955 | nan | 0.6930 | 0.9921 |
0.0026 | 428.57 | 3000 | 0.0564 | 0.8421 | 0.9088 | 0.9923 | nan | 0.8215 | 0.9960 | nan | 0.6919 | 0.9922 |
0.0031 | 434.29 | 3040 | 0.0523 | 0.8440 | 0.9105 | 0.9924 | nan | 0.8249 | 0.9960 | nan | 0.6958 | 0.9923 |
0.0024 | 440.0 | 3080 | 0.0544 | 0.8440 | 0.9115 | 0.9924 | nan | 0.8271 | 0.9960 | nan | 0.6957 | 0.9923 |
0.0022 | 445.71 | 3120 | 0.0540 | 0.8431 | 0.9112 | 0.9924 | nan | 0.8266 | 0.9959 | nan | 0.6940 | 0.9922 |
0.0023 | 451.43 | 3160 | 0.0539 | 0.8430 | 0.9099 | 0.9924 | nan | 0.8238 | 0.9960 | nan | 0.6937 | 0.9922 |
0.0022 | 457.14 | 3200 | 0.0555 | 0.8421 | 0.9079 | 0.9923 | nan | 0.8198 | 0.9960 | nan | 0.6920 | 0.9922 |
0.002 | 462.86 | 3240 | 0.0571 | 0.8413 | 0.9092 | 0.9923 | nan | 0.8226 | 0.9959 | nan | 0.6905 | 0.9921 |
0.0024 | 468.57 | 3280 | 0.0581 | 0.8417 | 0.9095 | 0.9923 | nan | 0.8230 | 0.9959 | nan | 0.6913 | 0.9922 |
0.0022 | 474.29 | 3320 | 0.0554 | 0.8432 | 0.9116 | 0.9924 | nan | 0.8273 | 0.9959 | nan | 0.6943 | 0.9922 |
0.0019 | 480.0 | 3360 | 0.0567 | 0.8404 | 0.9071 | 0.9922 | nan | 0.8182 | 0.9960 | nan | 0.6886 | 0.9921 |
0.0027 | 485.71 | 3400 | 0.0535 | 0.8425 | 0.9143 | 0.9923 | nan | 0.8330 | 0.9957 | nan | 0.6928 | 0.9921 |
0.0027 | 491.43 | 3440 | 0.0558 | 0.8408 | 0.9059 | 0.9923 | nan | 0.8158 | 0.9961 | nan | 0.6895 | 0.9922 |
0.003 | 497.14 | 3480 | 0.0555 | 0.8417 | 0.9096 | 0.9923 | nan | 0.8233 | 0.9959 | nan | 0.6913 | 0.9922 |
0.0023 | 502.86 | 3520 | 0.0567 | 0.8407 | 0.9061 | 0.9923 | nan | 0.8162 | 0.9961 | nan | 0.6893 | 0.9922 |
0.0023 | 508.57 | 3560 | 0.0550 | 0.8421 | 0.9111 | 0.9923 | nan | 0.8263 | 0.9958 | nan | 0.6921 | 0.9922 |
0.0023 | 514.29 | 3600 | 0.0565 | 0.8412 | 0.9102 | 0.9922 | nan | 0.8245 | 0.9958 | nan | 0.6903 | 0.9921 |
0.0018 | 520.0 | 3640 | 0.0554 | 0.8401 | 0.9067 | 0.9922 | nan | 0.8174 | 0.9960 | nan | 0.6881 | 0.9921 |
0.0022 | 525.71 | 3680 | 0.0563 | 0.8400 | 0.9053 | 0.9922 | nan | 0.8146 | 0.9961 | nan | 0.6878 | 0.9921 |
0.0023 | 531.43 | 3720 | 0.0584 | 0.8409 | 0.9081 | 0.9923 | nan | 0.8202 | 0.9959 | nan | 0.6896 | 0.9921 |
0.0023 | 537.14 | 3760 | 0.0599 | 0.8392 | 0.9072 | 0.9922 | nan | 0.8185 | 0.9959 | nan | 0.6863 | 0.9920 |
0.002 | 542.86 | 3800 | 0.0592 | 0.8412 | 0.9088 | 0.9923 | nan | 0.8217 | 0.9959 | nan | 0.6902 | 0.9921 |
0.0024 | 548.57 | 3840 | 0.0585 | 0.8393 | 0.9075 | 0.9922 | nan | 0.8191 | 0.9959 | nan | 0.6867 | 0.9920 |
0.0024 | 554.29 | 3880 | 0.0588 | 0.8423 | 0.9093 | 0.9923 | nan | 0.8226 | 0.9960 | nan | 0.6924 | 0.9922 |
0.0019 | 560.0 | 3920 | 0.0605 | 0.8426 | 0.9127 | 0.9923 | nan | 0.8297 | 0.9958 | nan | 0.6930 | 0.9922 |
0.0022 | 565.71 | 3960 | 0.0592 | 0.8400 | 0.9087 | 0.9922 | nan | 0.8215 | 0.9958 | nan | 0.6879 | 0.9920 |
0.0019 | 571.43 | 4000 | 0.0578 | 0.8399 | 0.9092 | 0.9922 | nan | 0.8226 | 0.9958 | nan | 0.6878 | 0.9920 |
0.0038 | 577.14 | 4040 | 0.0520 | 0.8376 | 0.9012 | 0.9922 | nan | 0.8063 | 0.9961 | nan | 0.6831 | 0.9920 |
0.0058 | 582.86 | 4080 | 0.0413 | 0.8634 | 0.9125 | 0.9937 | nan | 0.8278 | 0.9972 | nan | 0.7332 | 0.9936 |
0.0024 | 588.57 | 4120 | 0.0493 | 0.8505 | 0.9145 | 0.9928 | nan | 0.8329 | 0.9962 | nan | 0.7084 | 0.9927 |
0.0023 | 594.29 | 4160 | 0.0479 | 0.8572 | 0.9096 | 0.9933 | nan | 0.8222 | 0.9970 | nan | 0.7211 | 0.9932 |
0.0034 | 600.0 | 4200 | 0.0503 | 0.8539 | 0.9045 | 0.9932 | nan | 0.8118 | 0.9971 | nan | 0.7148 | 0.9931 |
0.0023 | 605.71 | 4240 | 0.0609 | 0.8426 | 0.9115 | 0.9923 | nan | 0.8272 | 0.9959 | nan | 0.6929 | 0.9922 |
0.0018 | 611.43 | 4280 | 0.0625 | 0.8434 | 0.9120 | 0.9924 | nan | 0.8281 | 0.9959 | nan | 0.6946 | 0.9922 |
0.0019 | 617.14 | 4320 | 0.0602 | 0.8437 | 0.9109 | 0.9924 | nan | 0.8259 | 0.9960 | nan | 0.6952 | 0.9923 |
0.0025 | 622.86 | 4360 | 0.0602 | 0.8447 | 0.9126 | 0.9924 | nan | 0.8293 | 0.9959 | nan | 0.6971 | 0.9923 |
0.0022 | 628.57 | 4400 | 0.0618 | 0.8431 | 0.9118 | 0.9923 | nan | 0.8277 | 0.9959 | nan | 0.6940 | 0.9922 |
0.0018 | 634.29 | 4440 | 0.0622 | 0.8428 | 0.9088 | 0.9924 | nan | 0.8215 | 0.9960 | nan | 0.6933 | 0.9922 |
0.002 | 640.0 | 4480 | 0.0618 | 0.8445 | 0.9111 | 0.9925 | nan | 0.8262 | 0.9960 | nan | 0.6967 | 0.9923 |
0.0018 | 645.71 | 4520 | 0.0632 | 0.8433 | 0.9127 | 0.9923 | nan | 0.8296 | 0.9958 | nan | 0.6944 | 0.9922 |
0.0018 | 651.43 | 4560 | 0.0639 | 0.8442 | 0.9140 | 0.9924 | nan | 0.8323 | 0.9958 | nan | 0.6962 | 0.9923 |
0.0019 | 657.14 | 4600 | 0.0490 | 0.8564 | 0.9092 | 0.9933 | nan | 0.8214 | 0.9970 | nan | 0.7196 | 0.9932 |
0.002 | 662.86 | 4640 | 0.0615 | 0.8422 | 0.9075 | 0.9924 | nan | 0.8189 | 0.9961 | nan | 0.6921 | 0.9922 |
0.0018 | 668.57 | 4680 | 0.0593 | 0.8419 | 0.9115 | 0.9923 | nan | 0.8271 | 0.9958 | nan | 0.6916 | 0.9921 |
0.0025 | 674.29 | 4720 | 0.0592 | 0.8438 | 0.9096 | 0.9924 | nan | 0.8232 | 0.9961 | nan | 0.6953 | 0.9923 |
0.0018 | 680.0 | 4760 | 0.0621 | 0.8426 | 0.9101 | 0.9923 | nan | 0.8243 | 0.9959 | nan | 0.6929 | 0.9922 |
0.0018 | 685.71 | 4800 | 0.0644 | 0.8427 | 0.9144 | 0.9923 | nan | 0.8331 | 0.9957 | nan | 0.6932 | 0.9921 |
0.0016 | 691.43 | 4840 | 0.0619 | 0.8425 | 0.9121 | 0.9923 | nan | 0.8284 | 0.9958 | nan | 0.6929 | 0.9922 |
0.0017 | 697.14 | 4880 | 0.0618 | 0.8422 | 0.9090 | 0.9923 | nan | 0.8220 | 0.9960 | nan | 0.6922 | 0.9922 |
0.0016 | 702.86 | 4920 | 0.0634 | 0.8435 | 0.9091 | 0.9924 | nan | 0.8221 | 0.9961 | nan | 0.6948 | 0.9923 |
0.0015 | 708.57 | 4960 | 0.0647 | 0.8427 | 0.9077 | 0.9924 | nan | 0.8194 | 0.9961 | nan | 0.6931 | 0.9923 |
0.0017 | 714.29 | 5000 | 0.0647 | 0.8435 | 0.9104 | 0.9924 | nan | 0.8249 | 0.9960 | nan | 0.6947 | 0.9923 |
0.0017 | 720.0 | 5040 | 0.0673 | 0.8420 | 0.9114 | 0.9923 | nan | 0.8271 | 0.9958 | nan | 0.6918 | 0.9921 |
0.0024 | 725.71 | 5080 | 0.0704 | 0.8370 | 0.8950 | 0.9922 | nan | 0.7936 | 0.9965 | nan | 0.6818 | 0.9921 |
0.0056 | 731.43 | 5120 | 0.0495 | 0.8458 | 0.9124 | 0.9925 | nan | 0.8289 | 0.9960 | nan | 0.6991 | 0.9924 |
0.0186 | 737.14 | 5160 | 0.0274 | 0.8416 | 0.8743 | 0.9929 | nan | 0.7504 | 0.9981 | nan | 0.6903 | 0.9928 |
0.0057 | 742.86 | 5200 | 0.0257 | 0.8638 | 0.8944 | 0.9940 | nan | 0.7905 | 0.9983 | nan | 0.7338 | 0.9939 |
0.0051 | 748.57 | 5240 | 0.0303 | 0.8584 | 0.9084 | 0.9934 | nan | 0.8196 | 0.9972 | nan | 0.7235 | 0.9933 |
0.004 | 754.29 | 5280 | 0.0382 | 0.8414 | 0.9090 | 0.9923 | nan | 0.8220 | 0.9959 | nan | 0.6906 | 0.9921 |
0.0032 | 760.0 | 5320 | 0.0345 | 0.8609 | 0.9011 | 0.9937 | nan | 0.8045 | 0.9978 | nan | 0.7282 | 0.9936 |
0.0029 | 765.71 | 5360 | 0.0379 | 0.8669 | 0.8998 | 0.9941 | nan | 0.8013 | 0.9982 | nan | 0.7399 | 0.9940 |
0.0028 | 771.43 | 5400 | 0.0390 | 0.8657 | 0.8971 | 0.9941 | nan | 0.7959 | 0.9983 | nan | 0.7374 | 0.9940 |
0.0028 | 777.14 | 5440 | 0.0399 | 0.8645 | 0.9036 | 0.9939 | nan | 0.8094 | 0.9978 | nan | 0.7353 | 0.9938 |
0.0029 | 782.86 | 5480 | 0.0387 | 0.8683 | 0.9036 | 0.9941 | nan | 0.8090 | 0.9981 | nan | 0.7425 | 0.9940 |
0.0025 | 788.57 | 5520 | 0.0407 | 0.8600 | 0.9055 | 0.9936 | nan | 0.8136 | 0.9974 | nan | 0.7265 | 0.9935 |
0.0023 | 794.29 | 5560 | 0.0415 | 0.8593 | 0.9100 | 0.9935 | nan | 0.8228 | 0.9971 | nan | 0.7252 | 0.9933 |
0.0021 | 800.0 | 5600 | 0.0445 | 0.8571 | 0.9101 | 0.9933 | nan | 0.8231 | 0.9970 | nan | 0.7211 | 0.9932 |
0.0022 | 805.71 | 5640 | 0.0451 | 0.8549 | 0.9082 | 0.9932 | nan | 0.8195 | 0.9969 | nan | 0.7168 | 0.9931 |
0.0019 | 811.43 | 5680 | 0.0459 | 0.8554 | 0.9076 | 0.9933 | nan | 0.8182 | 0.9970 | nan | 0.7177 | 0.9931 |
0.0022 | 817.14 | 5720 | 0.0443 | 0.8623 | 0.9077 | 0.9937 | nan | 0.8179 | 0.9975 | nan | 0.7310 | 0.9936 |
0.0021 | 822.86 | 5760 | 0.0445 | 0.8616 | 0.9067 | 0.9937 | nan | 0.8159 | 0.9975 | nan | 0.7296 | 0.9936 |
0.0019 | 828.57 | 5800 | 0.0463 | 0.8575 | 0.9101 | 0.9933 | nan | 0.8232 | 0.9970 | nan | 0.7218 | 0.9932 |
0.0019 | 834.29 | 5840 | 0.0475 | 0.8581 | 0.9140 | 0.9933 | nan | 0.8312 | 0.9968 | nan | 0.7230 | 0.9932 |
0.002 | 840.0 | 5880 | 0.0453 | 0.8618 | 0.9076 | 0.9937 | nan | 0.8178 | 0.9974 | nan | 0.7300 | 0.9935 |
0.002 | 845.71 | 5920 | 0.0472 | 0.8592 | 0.9080 | 0.9935 | nan | 0.8188 | 0.9972 | nan | 0.7251 | 0.9934 |
0.0017 | 851.43 | 5960 | 0.0485 | 0.8582 | 0.9096 | 0.9934 | nan | 0.8221 | 0.9971 | nan | 0.7231 | 0.9933 |
0.0018 | 857.14 | 6000 | 0.0494 | 0.8575 | 0.9079 | 0.9934 | nan | 0.8186 | 0.9971 | nan | 0.7217 | 0.9933 |
0.002 | 862.86 | 6040 | 0.0479 | 0.8613 | 0.9091 | 0.9936 | nan | 0.8210 | 0.9973 | nan | 0.7291 | 0.9935 |
0.002 | 868.57 | 6080 | 0.0479 | 0.8607 | 0.9092 | 0.9936 | nan | 0.8211 | 0.9973 | nan | 0.7279 | 0.9935 |
0.0018 | 874.29 | 6120 | 0.0490 | 0.8596 | 0.9055 | 0.9936 | nan | 0.8135 | 0.9974 | nan | 0.7257 | 0.9934 |
0.0019 | 880.0 | 6160 | 0.0501 | 0.8602 | 0.9103 | 0.9935 | nan | 0.8234 | 0.9972 | nan | 0.7270 | 0.9934 |
0.0017 | 885.71 | 6200 | 0.0495 | 0.8593 | 0.9071 | 0.9935 | nan | 0.8169 | 0.9973 | nan | 0.7251 | 0.9934 |
0.0022 | 891.43 | 6240 | 0.0518 | 0.8577 | 0.9093 | 0.9934 | nan | 0.8216 | 0.9970 | nan | 0.7221 | 0.9933 |
0.0017 | 897.14 | 6280 | 0.0528 | 0.8578 | 0.9098 | 0.9934 | nan | 0.8225 | 0.9970 | nan | 0.7224 | 0.9933 |
0.0018 | 902.86 | 6320 | 0.0509 | 0.8583 | 0.9076 | 0.9934 | nan | 0.8179 | 0.9972 | nan | 0.7233 | 0.9933 |
0.0016 | 908.57 | 6360 | 0.0515 | 0.8580 | 0.9100 | 0.9934 | nan | 0.8230 | 0.9970 | nan | 0.7228 | 0.9933 |
0.0018 | 914.29 | 6400 | 0.0513 | 0.8574 | 0.9056 | 0.9934 | nan | 0.8139 | 0.9973 | nan | 0.7215 | 0.9933 |
0.0019 | 920.0 | 6440 | 0.0532 | 0.8581 | 0.9103 | 0.9934 | nan | 0.8236 | 0.9970 | nan | 0.7229 | 0.9933 |
0.0017 | 925.71 | 6480 | 0.0536 | 0.8578 | 0.9099 | 0.9934 | nan | 0.8228 | 0.9970 | nan | 0.7223 | 0.9932 |
0.0014 | 931.43 | 6520 | 0.0539 | 0.8587 | 0.9107 | 0.9934 | nan | 0.8245 | 0.9970 | nan | 0.7242 | 0.9933 |
0.0015 | 937.14 | 6560 | 0.0539 | 0.8582 | 0.9124 | 0.9934 | nan | 0.8280 | 0.9969 | nan | 0.7232 | 0.9932 |
0.0017 | 942.86 | 6600 | 0.0551 | 0.8584 | 0.9123 | 0.9934 | nan | 0.8278 | 0.9969 | nan | 0.7235 | 0.9932 |
0.0014 | 948.57 | 6640 | 0.0545 | 0.8585 | 0.9094 | 0.9934 | nan | 0.8217 | 0.9971 | nan | 0.7236 | 0.9933 |
0.0015 | 954.29 | 6680 | 0.0540 | 0.8577 | 0.9077 | 0.9934 | nan | 0.8182 | 0.9971 | nan | 0.7221 | 0.9933 |
0.0015 | 960.0 | 6720 | 0.0475 | 0.8708 | 0.9067 | 0.9942 | nan | 0.8153 | 0.9981 | nan | 0.7475 | 0.9941 |
0.0017 | 965.71 | 6760 | 0.0495 | 0.8683 | 0.9035 | 0.9941 | nan | 0.8090 | 0.9981 | nan | 0.7426 | 0.9940 |
0.0017 | 971.43 | 6800 | 0.0520 | 0.8670 | 0.9058 | 0.9940 | nan | 0.8137 | 0.9979 | nan | 0.7401 | 0.9939 |
0.0019 | 977.14 | 6840 | 0.0528 | 0.8676 | 0.9096 | 0.9940 | nan | 0.8215 | 0.9977 | nan | 0.7413 | 0.9939 |
0.0018 | 982.86 | 6880 | 0.0542 | 0.8656 | 0.9047 | 0.9939 | nan | 0.8116 | 0.9978 | nan | 0.7373 | 0.9938 |
0.0016 | 988.57 | 6920 | 0.0537 | 0.8651 | 0.9024 | 0.9939 | nan | 0.8068 | 0.9980 | nan | 0.7364 | 0.9938 |
0.0018 | 994.29 | 6960 | 0.0530 | 0.8622 | 0.9112 | 0.9936 | nan | 0.8251 | 0.9972 | nan | 0.7309 | 0.9935 |
0.0017 | 1000.0 | 7000 | 0.0522 | 0.8660 | 0.9125 | 0.9938 | nan | 0.8275 | 0.9974 | nan | 0.7382 | 0.9937 |
0.0016 | 1005.71 | 7040 | 0.0528 | 0.8659 | 0.9129 | 0.9938 | nan | 0.8285 | 0.9974 | nan | 0.7380 | 0.9937 |
0.0016 | 1011.43 | 7080 | 0.0531 | 0.8652 | 0.9100 | 0.9938 | nan | 0.8225 | 0.9975 | nan | 0.7367 | 0.9937 |
0.0017 | 1017.14 | 7120 | 0.0528 | 0.8664 | 0.9098 | 0.9939 | nan | 0.8219 | 0.9976 | nan | 0.7391 | 0.9938 |
0.0014 | 1022.86 | 7160 | 0.0536 | 0.8670 | 0.9098 | 0.9940 | nan | 0.8220 | 0.9976 | nan | 0.7402 | 0.9938 |
0.0013 | 1028.57 | 7200 | 0.0550 | 0.8654 | 0.9086 | 0.9939 | nan | 0.8197 | 0.9976 | nan | 0.7370 | 0.9938 |
0.0017 | 1034.29 | 7240 | 0.0526 | 0.8662 | 0.9072 | 0.9939 | nan | 0.8167 | 0.9977 | nan | 0.7385 | 0.9938 |
0.0014 | 1040.0 | 7280 | 0.0542 | 0.8661 | 0.9090 | 0.9939 | nan | 0.8203 | 0.9976 | nan | 0.7384 | 0.9938 |
0.0015 | 1045.71 | 7320 | 0.0546 | 0.8672 | 0.9113 | 0.9939 | nan | 0.8250 | 0.9976 | nan | 0.7405 | 0.9938 |
0.0019 | 1051.43 | 7360 | 0.0668 | 0.8457 | 0.9101 | 0.9926 | nan | 0.8240 | 0.9962 | nan | 0.6990 | 0.9924 |
0.0015 | 1057.14 | 7400 | 0.0646 | 0.8462 | 0.9107 | 0.9926 | nan | 0.8252 | 0.9962 | nan | 0.6999 | 0.9925 |
0.0015 | 1062.86 | 7440 | 0.0644 | 0.8466 | 0.9095 | 0.9926 | nan | 0.8227 | 0.9963 | nan | 0.7007 | 0.9925 |
0.0014 | 1068.57 | 7480 | 0.0619 | 0.8529 | 0.9119 | 0.9930 | nan | 0.8271 | 0.9966 | nan | 0.7128 | 0.9929 |
0.0017 | 1074.29 | 7520 | 0.0602 | 0.8556 | 0.9107 | 0.9932 | nan | 0.8246 | 0.9968 | nan | 0.7182 | 0.9931 |
0.0016 | 1080.0 | 7560 | 0.0617 | 0.8530 | 0.9089 | 0.9931 | nan | 0.8211 | 0.9968 | nan | 0.7130 | 0.9929 |
0.0015 | 1085.71 | 7600 | 0.0611 | 0.8540 | 0.9100 | 0.9931 | nan | 0.8233 | 0.9968 | nan | 0.7151 | 0.9930 |
0.0014 | 1091.43 | 7640 | 0.0607 | 0.8565 | 0.9104 | 0.9933 | nan | 0.8239 | 0.9969 | nan | 0.7199 | 0.9932 |
0.0012 | 1097.14 | 7680 | 0.0608 | 0.8604 | 0.9092 | 0.9935 | nan | 0.8212 | 0.9972 | nan | 0.7274 | 0.9934 |
0.0013 | 1102.86 | 7720 | 0.0603 | 0.8618 | 0.9088 | 0.9936 | nan | 0.8202 | 0.9974 | nan | 0.7300 | 0.9935 |
0.0018 | 1108.57 | 7760 | 0.0608 | 0.8605 | 0.9094 | 0.9935 | nan | 0.8216 | 0.9972 | nan | 0.7275 | 0.9934 |
0.0015 | 1114.29 | 7800 | 0.0606 | 0.8619 | 0.9088 | 0.9936 | nan | 0.8203 | 0.9974 | nan | 0.7302 | 0.9935 |
0.0015 | 1120.0 | 7840 | 0.0602 | 0.8616 | 0.9077 | 0.9936 | nan | 0.8181 | 0.9974 | nan | 0.7298 | 0.9935 |
0.0014 | 1125.71 | 7880 | 0.0606 | 0.8628 | 0.9086 | 0.9937 | nan | 0.8198 | 0.9974 | nan | 0.7320 | 0.9936 |
0.0012 | 1131.43 | 7920 | 0.0613 | 0.8599 | 0.9094 | 0.9935 | nan | 0.8217 | 0.9972 | nan | 0.7264 | 0.9934 |
0.0013 | 1137.14 | 7960 | 0.0627 | 0.8598 | 0.9099 | 0.9935 | nan | 0.8225 | 0.9972 | nan | 0.7261 | 0.9934 |
0.0014 | 1142.86 | 8000 | 0.0614 | 0.8614 | 0.9098 | 0.9936 | nan | 0.8224 | 0.9973 | nan | 0.7294 | 0.9935 |
0.0016 | 1148.57 | 8040 | 0.0620 | 0.8612 | 0.9105 | 0.9936 | nan | 0.8238 | 0.9972 | nan | 0.7290 | 0.9935 |
0.0013 | 1154.29 | 8080 | 0.0610 | 0.8626 | 0.9102 | 0.9937 | nan | 0.8232 | 0.9973 | nan | 0.7317 | 0.9936 |
0.0013 | 1160.0 | 8120 | 0.0625 | 0.8617 | 0.9098 | 0.9936 | nan | 0.8222 | 0.9973 | nan | 0.7299 | 0.9935 |
0.0016 | 1165.71 | 8160 | 0.0617 | 0.8625 | 0.9092 | 0.9937 | nan | 0.8210 | 0.9974 | nan | 0.7314 | 0.9936 |
0.0015 | 1171.43 | 8200 | 0.0622 | 0.8639 | 0.9099 | 0.9938 | nan | 0.8224 | 0.9974 | nan | 0.7341 | 0.9936 |
0.0012 | 1177.14 | 8240 | 0.0634 | 0.8629 | 0.9089 | 0.9937 | nan | 0.8204 | 0.9974 | nan | 0.7321 | 0.9936 |
0.0014 | 1182.86 | 8280 | 0.0634 | 0.8615 | 0.9096 | 0.9936 | nan | 0.8220 | 0.9973 | nan | 0.7296 | 0.9935 |
0.0011 | 1188.57 | 8320 | 0.0640 | 0.8618 | 0.9090 | 0.9936 | nan | 0.8206 | 0.9973 | nan | 0.7300 | 0.9935 |
0.0015 | 1194.29 | 8360 | 0.0635 | 0.8627 | 0.9081 | 0.9937 | nan | 0.8188 | 0.9975 | nan | 0.7318 | 0.9936 |
0.0018 | 1200.0 | 8400 | 0.0630 | 0.8625 | 0.9089 | 0.9937 | nan | 0.8204 | 0.9974 | nan | 0.7314 | 0.9936 |
0.0014 | 1205.71 | 8440 | 0.0635 | 0.8629 | 0.9085 | 0.9937 | nan | 0.8196 | 0.9974 | nan | 0.7323 | 0.9936 |
0.0012 | 1211.43 | 8480 | 0.0641 | 0.8619 | 0.9082 | 0.9937 | nan | 0.8190 | 0.9974 | nan | 0.7302 | 0.9935 |
0.0009 | 1217.14 | 8520 | 0.0644 | 0.8619 | 0.9091 | 0.9936 | nan | 0.8208 | 0.9973 | nan | 0.7302 | 0.9935 |
0.0014 | 1222.86 | 8560 | 0.0641 | 0.8612 | 0.9091 | 0.9936 | nan | 0.8210 | 0.9973 | nan | 0.7288 | 0.9935 |
0.0012 | 1228.57 | 8600 | 0.0646 | 0.8617 | 0.9092 | 0.9936 | nan | 0.8210 | 0.9973 | nan | 0.7299 | 0.9935 |
0.0012 | 1234.29 | 8640 | 0.0648 | 0.8616 | 0.9084 | 0.9936 | nan | 0.8194 | 0.9974 | nan | 0.7297 | 0.9935 |
0.0052 | 1240.0 | 8680 | 0.0667 | 0.8612 | 0.9131 | 0.9935 | nan | 0.8291 | 0.9971 | nan | 0.7289 | 0.9934 |
0.0014 | 1245.71 | 8720 | 0.0687 | 0.8564 | 0.9191 | 0.9931 | nan | 0.8419 | 0.9964 | nan | 0.7199 | 0.9930 |
0.0015 | 1251.43 | 8760 | 0.0653 | 0.8631 | 0.9172 | 0.9936 | nan | 0.8375 | 0.9969 | nan | 0.7328 | 0.9935 |
0.0013 | 1257.14 | 8800 | 0.0660 | 0.8627 | 0.9172 | 0.9936 | nan | 0.8375 | 0.9969 | nan | 0.7320 | 0.9935 |
0.0016 | 1262.86 | 8840 | 0.0661 | 0.8625 | 0.9177 | 0.9935 | nan | 0.8385 | 0.9969 | nan | 0.7315 | 0.9934 |
0.0013 | 1268.57 | 8880 | 0.0631 | 0.8643 | 0.9107 | 0.9938 | nan | 0.8239 | 0.9974 | nan | 0.7349 | 0.9937 |
0.0023 | 1274.29 | 8920 | 0.0549 | 0.8588 | 0.9070 | 0.9935 | nan | 0.8167 | 0.9973 | nan | 0.7242 | 0.9934 |
0.0017 | 1280.0 | 8960 | 0.0568 | 0.8609 | 0.9126 | 0.9935 | nan | 0.8282 | 0.9971 | nan | 0.7284 | 0.9934 |
0.0016 | 1285.71 | 9000 | 0.0594 | 0.8609 | 0.9134 | 0.9935 | nan | 0.8298 | 0.9970 | nan | 0.7283 | 0.9934 |
0.0018 | 1291.43 | 9040 | 0.0608 | 0.8606 | 0.9134 | 0.9935 | nan | 0.8298 | 0.9970 | nan | 0.7279 | 0.9934 |
0.0014 | 1297.14 | 9080 | 0.0621 | 0.8608 | 0.9127 | 0.9935 | nan | 0.8283 | 0.9971 | nan | 0.7281 | 0.9934 |
0.0012 | 1302.86 | 9120 | 0.0620 | 0.8613 | 0.9122 | 0.9936 | nan | 0.8272 | 0.9971 | nan | 0.7292 | 0.9934 |
0.0016 | 1308.57 | 9160 | 0.0625 | 0.8616 | 0.9128 | 0.9936 | nan | 0.8285 | 0.9971 | nan | 0.7298 | 0.9935 |
0.0012 | 1314.29 | 9200 | 0.0626 | 0.8616 | 0.9120 | 0.9936 | nan | 0.8269 | 0.9971 | nan | 0.7297 | 0.9935 |
0.0012 | 1320.0 | 9240 | 0.0628 | 0.8621 | 0.9120 | 0.9936 | nan | 0.8268 | 0.9972 | nan | 0.7306 | 0.9935 |
0.0012 | 1325.71 | 9280 | 0.0631 | 0.8618 | 0.9117 | 0.9936 | nan | 0.8261 | 0.9972 | nan | 0.7301 | 0.9935 |
0.0014 | 1331.43 | 9320 | 0.0632 | 0.8616 | 0.9125 | 0.9936 | nan | 0.8279 | 0.9971 | nan | 0.7297 | 0.9935 |
0.0014 | 1337.14 | 9360 | 0.0650 | 0.8607 | 0.9142 | 0.9935 | nan | 0.8315 | 0.9970 | nan | 0.7280 | 0.9934 |
0.0016 | 1342.86 | 9400 | 0.0659 | 0.8588 | 0.9138 | 0.9934 | nan | 0.8307 | 0.9969 | nan | 0.7243 | 0.9933 |
0.0012 | 1348.57 | 9440 | 0.0661 | 0.8585 | 0.9133 | 0.9934 | nan | 0.8298 | 0.9969 | nan | 0.7237 | 0.9932 |
0.0014 | 1354.29 | 9480 | 0.0657 | 0.8592 | 0.9133 | 0.9934 | nan | 0.8296 | 0.9969 | nan | 0.7252 | 0.9933 |
0.001 | 1360.0 | 9520 | 0.0659 | 0.8594 | 0.9137 | 0.9934 | nan | 0.8305 | 0.9969 | nan | 0.7256 | 0.9933 |
0.0012 | 1365.71 | 9560 | 0.0652 | 0.8620 | 0.9122 | 0.9936 | nan | 0.8273 | 0.9972 | nan | 0.7306 | 0.9935 |
0.0012 | 1371.43 | 9600 | 0.0654 | 0.8620 | 0.9122 | 0.9936 | nan | 0.8271 | 0.9972 | nan | 0.7305 | 0.9935 |
0.0014 | 1377.14 | 9640 | 0.0652 | 0.8619 | 0.9125 | 0.9936 | nan | 0.8279 | 0.9971 | nan | 0.7304 | 0.9935 |
0.0015 | 1382.86 | 9680 | 0.0652 | 0.8618 | 0.9126 | 0.9936 | nan | 0.8281 | 0.9971 | nan | 0.7302 | 0.9935 |
0.0014 | 1388.57 | 9720 | 0.0651 | 0.8608 | 0.9139 | 0.9935 | nan | 0.8309 | 0.9970 | nan | 0.7282 | 0.9934 |
0.0011 | 1394.29 | 9760 | 0.0656 | 0.8605 | 0.9139 | 0.9935 | nan | 0.8309 | 0.9970 | nan | 0.7277 | 0.9934 |
0.0013 | 1400.0 | 9800 | 0.0656 | 0.8606 | 0.9137 | 0.9935 | nan | 0.8303 | 0.9970 | nan | 0.7278 | 0.9934 |
Framework versions
- Transformers 4.30.2
- Pytorch 2.0.1+cu117
- Datasets 2.13.1
- Tokenizers 0.13.3