<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
11jul-filtered_tweets
This model is a fine-tuned version of ./model_tweets_2019 on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 2.5545
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 4.1e-07
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.98) and epsilon=1e-08
- lr_scheduler_type: linear
- training_steps: 2400000
Training results
Training Loss | Epoch | Step | Validation Loss |
---|---|---|---|
No log | 0.25 | 8000 | 2.9512 |
3.1757 | 0.5 | 16000 | 2.8425 |
3.1757 | 0.75 | 24000 | 2.7666 |
2.924 | 1.0 | 32000 | 2.7425 |
2.924 | 1.25 | 40000 | 2.7106 |
2.8592 | 1.5 | 48000 | 2.6844 |
2.8592 | 1.75 | 56000 | 2.7093 |
2.83 | 2.0 | 64000 | 2.6717 |
2.83 | 2.25 | 72000 | 2.6630 |
2.8028 | 2.5 | 80000 | 2.6702 |
2.8028 | 2.75 | 88000 | 2.6711 |
2.7946 | 3.0 | 96000 | 2.6588 |
2.7946 | 3.26 | 104000 | 2.6297 |
2.7786 | 3.51 | 112000 | 2.6587 |
2.7786 | 3.76 | 120000 | 2.6469 |
2.7714 | 4.01 | 128000 | 2.6386 |
2.7714 | 4.26 | 136000 | 2.6694 |
2.7638 | 4.51 | 144000 | 2.6297 |
2.7638 | 4.76 | 152000 | 2.6502 |
2.7644 | 5.01 | 160000 | 2.6578 |
2.7644 | 5.26 | 168000 | 2.6088 |
2.7531 | 5.51 | 176000 | 2.6317 |
2.7531 | 5.76 | 184000 | 2.6299 |
2.759 | 6.01 | 192000 | 2.6422 |
2.759 | 6.26 | 200000 | 2.6136 |
2.7496 | 6.51 | 208000 | 2.6363 |
2.7496 | 6.76 | 216000 | 2.6274 |
2.7529 | 7.01 | 224000 | 2.6160 |
2.7529 | 7.26 | 232000 | 2.6298 |
2.7456 | 7.51 | 240000 | 2.6208 |
2.7456 | 7.76 | 248000 | 2.6095 |
2.7404 | 8.01 | 256000 | 2.6069 |
2.7404 | 8.26 | 264000 | 2.5831 |
2.7355 | 8.51 | 272000 | 2.6136 |
2.7355 | 8.76 | 280000 | 2.6075 |
2.7345 | 9.01 | 288000 | 2.5976 |
2.7345 | 9.26 | 296000 | 2.6100 |
2.7324 | 9.52 | 304000 | 2.6142 |
2.7324 | 9.77 | 312000 | 2.6072 |
2.7308 | 10.02 | 320000 | 2.6105 |
2.7308 | 10.27 | 328000 | 2.6167 |
2.7272 | 10.52 | 336000 | 2.5891 |
2.7272 | 10.77 | 344000 | 2.6084 |
2.736 | 11.02 | 352000 | 2.6131 |
2.736 | 11.27 | 360000 | 2.5864 |
2.7318 | 11.52 | 368000 | 2.6184 |
2.7318 | 11.77 | 376000 | 2.5971 |
2.7345 | 12.02 | 384000 | 2.5649 |
2.7345 | 12.27 | 392000 | 2.5936 |
2.7249 | 12.52 | 400000 | 2.6101 |
2.7249 | 12.77 | 408000 | 2.5798 |
2.7351 | 13.02 | 416000 | 2.5903 |
2.7351 | 13.27 | 424000 | 2.6260 |
2.7255 | 13.52 | 432000 | 2.6194 |
2.7255 | 13.77 | 440000 | 2.6140 |
2.7249 | 14.02 | 448000 | 2.5795 |
2.7249 | 14.27 | 456000 | 2.5961 |
2.7217 | 14.52 | 464000 | 2.5972 |
2.7217 | 14.77 | 472000 | 2.5877 |
2.7246 | 15.02 | 480000 | 2.5760 |
2.7246 | 15.27 | 488000 | 2.5926 |
2.7223 | 15.52 | 496000 | 2.6017 |
2.7223 | 15.78 | 504000 | 2.5969 |
2.7261 | 16.03 | 512000 | 2.5919 |
2.7261 | 16.28 | 520000 | 2.6044 |
2.7237 | 16.53 | 528000 | 2.6042 |
2.7237 | 16.78 | 536000 | 2.5812 |
2.7234 | 17.03 | 544000 | 2.5887 |
2.7234 | 17.28 | 552000 | 2.6220 |
2.7249 | 17.53 | 560000 | 2.5997 |
2.7249 | 17.78 | 568000 | 2.5860 |
2.7237 | 18.03 | 576000 | 2.6072 |
2.7237 | 18.28 | 584000 | 2.5817 |
2.7246 | 18.53 | 592000 | 2.5931 |
2.7246 | 18.78 | 600000 | 2.5815 |
2.7233 | 19.03 | 608000 | 2.5723 |
2.7233 | 19.28 | 616000 | 2.5887 |
2.7142 | 19.53 | 624000 | 2.5862 |
2.7142 | 19.78 | 632000 | 2.6196 |
2.7169 | 20.03 | 640000 | 2.5906 |
2.7169 | 20.28 | 648000 | 2.5897 |
2.7189 | 20.53 | 656000 | 2.6032 |
2.7189 | 20.78 | 664000 | 2.6001 |
2.7193 | 21.03 | 672000 | 2.5951 |
2.7193 | 21.28 | 680000 | 2.5839 |
2.7176 | 21.53 | 688000 | 2.5792 |
2.7176 | 21.78 | 696000 | 2.5972 |
2.7206 | 22.04 | 704000 | 2.5993 |
2.7206 | 22.29 | 712000 | 2.5966 |
2.7118 | 22.54 | 720000 | 2.5655 |
2.7118 | 22.79 | 728000 | 2.5832 |
2.7185 | 23.04 | 736000 | 2.5695 |
2.7185 | 23.29 | 744000 | 2.5662 |
2.7162 | 23.54 | 752000 | 2.5866 |
2.7162 | 23.79 | 760000 | 2.5729 |
2.714 | 24.04 | 768000 | 2.5876 |
2.714 | 24.29 | 776000 | 2.5816 |
2.7071 | 24.54 | 784000 | 2.6026 |
2.7071 | 24.79 | 792000 | 2.5834 |
2.7154 | 25.04 | 800000 | 2.5872 |
2.7154 | 25.29 | 808000 | 2.5804 |
2.7121 | 25.54 | 816000 | 2.6039 |
2.7121 | 25.79 | 824000 | 2.5803 |
2.7061 | 26.04 | 832000 | 2.5850 |
2.7061 | 26.29 | 840000 | 2.5766 |
2.7065 | 26.54 | 848000 | 2.5914 |
2.7065 | 26.79 | 856000 | 2.5810 |
2.7149 | 27.04 | 864000 | 2.5884 |
2.7149 | 27.29 | 872000 | 2.5676 |
2.7076 | 27.54 | 880000 | 2.5884 |
2.7076 | 27.79 | 888000 | 2.5598 |
2.7092 | 28.04 | 896000 | 2.5741 |
2.7092 | 28.3 | 904000 | 2.5898 |
2.7033 | 28.55 | 912000 | 2.5956 |
2.7033 | 28.8 | 920000 | 2.5792 |
2.7075 | 29.05 | 928000 | 2.5805 |
2.7075 | 29.3 | 936000 | 2.5790 |
2.7011 | 29.55 | 944000 | 2.5754 |
2.7011 | 29.8 | 952000 | 2.5768 |
2.7053 | 30.05 | 960000 | 2.5722 |
2.7053 | 30.3 | 968000 | 2.5683 |
2.6988 | 30.55 | 976000 | 2.5965 |
2.6988 | 30.8 | 984000 | 2.6246 |
2.7089 | 31.05 | 992000 | 2.6169 |
2.7089 | 31.3 | 1000000 | 2.5910 |
2.716 | 31.55 | 1008000 | 2.5767 |
2.716 | 31.8 | 1016000 | 2.5883 |
2.7103 | 32.05 | 1024000 | 2.5601 |
2.7103 | 32.3 | 1032000 | 2.5739 |
2.706 | 32.55 | 1040000 | 2.5870 |
2.706 | 32.8 | 1048000 | 2.5976 |
2.7088 | 33.05 | 1056000 | 2.5769 |
2.7088 | 33.3 | 1064000 | 2.5688 |
2.703 | 33.55 | 1072000 | 2.5604 |
2.703 | 33.8 | 1080000 | 2.5719 |
2.712 | 34.05 | 1088000 | 2.5797 |
2.712 | 34.3 | 1096000 | 2.5561 |
2.7008 | 34.56 | 1104000 | 2.5654 |
2.7008 | 34.81 | 1112000 | 2.5802 |
2.7052 | 35.06 | 1120000 | 2.5729 |
2.7052 | 35.31 | 1128000 | 2.5810 |
2.7031 | 35.56 | 1136000 | 2.5681 |
2.7031 | 35.81 | 1144000 | 2.5781 |
2.702 | 36.06 | 1152000 | 2.5811 |
2.702 | 36.31 | 1160000 | 2.5827 |
2.6986 | 36.56 | 1168000 | 2.5716 |
2.6986 | 36.81 | 1176000 | 2.5553 |
2.6985 | 37.06 | 1184000 | 2.5746 |
2.6985 | 37.31 | 1192000 | 2.5655 |
2.7042 | 37.56 | 1200000 | 2.5836 |
2.7042 | 37.81 | 1208000 | 2.5898 |
2.7093 | 38.06 | 1216000 | 2.5779 |
2.7093 | 38.31 | 1224000 | 2.5912 |
2.7108 | 38.56 | 1232000 | 2.5720 |
2.7108 | 38.81 | 1240000 | 2.5728 |
2.7023 | 39.06 | 1248000 | 2.5882 |
2.7023 | 39.31 | 1256000 | 2.5858 |
2.7025 | 39.56 | 1264000 | 2.5806 |
2.7025 | 39.81 | 1272000 | 2.5723 |
2.6993 | 40.06 | 1280000 | 2.5607 |
2.6993 | 40.31 | 1288000 | 2.5715 |
2.7042 | 40.56 | 1296000 | 2.5881 |
2.7042 | 40.82 | 1304000 | 2.5734 |
2.7006 | 41.07 | 1312000 | 2.5711 |
2.7006 | 41.32 | 1320000 | 2.5686 |
2.691 | 41.57 | 1328000 | 2.5655 |
2.691 | 41.82 | 1336000 | 2.5519 |
2.7039 | 42.07 | 1344000 | 2.5942 |
2.7039 | 42.32 | 1352000 | 2.5920 |
2.6979 | 42.57 | 1360000 | 2.5711 |
2.6979 | 42.82 | 1368000 | 2.5686 |
2.7027 | 43.07 | 1376000 | 2.5708 |
2.7027 | 43.32 | 1384000 | 2.5619 |
2.6982 | 43.57 | 1392000 | 2.5836 |
2.6982 | 43.82 | 1400000 | 2.5781 |
2.6998 | 44.07 | 1408000 | 2.5691 |
2.6998 | 44.32 | 1416000 | 2.5735 |
2.6933 | 44.57 | 1424000 | 2.5383 |
2.6933 | 44.82 | 1432000 | 2.5936 |
2.7026 | 45.07 | 1440000 | 2.5486 |
2.7026 | 45.32 | 1448000 | 2.5586 |
2.6928 | 45.57 | 1456000 | 2.5715 |
2.6928 | 45.82 | 1464000 | 2.5450 |
2.699 | 46.07 | 1472000 | 2.5726 |
2.699 | 46.32 | 1480000 | 2.5677 |
2.7 | 46.57 | 1488000 | 2.5615 |
2.7 | 46.82 | 1496000 | 2.5721 |
2.7014 | 47.08 | 1504000 | 2.5562 |
2.7014 | 47.33 | 1512000 | 2.5676 |
2.6924 | 47.58 | 1520000 | 2.5670 |
2.6924 | 47.83 | 1528000 | 2.5643 |
2.6918 | 48.08 | 1536000 | 2.5836 |
2.6918 | 48.33 | 1544000 | 2.5420 |
2.7047 | 48.58 | 1552000 | 2.5471 |
2.7047 | 48.83 | 1560000 | 2.5655 |
2.6875 | 49.08 | 1568000 | 2.5670 |
2.6875 | 49.33 | 1576000 | 2.5551 |
2.6966 | 49.58 | 1584000 | 2.5814 |
2.6966 | 49.83 | 1592000 | 2.5690 |
2.7004 | 50.08 | 1600000 | 2.5666 |
2.7004 | 50.33 | 1608000 | 2.5571 |
2.6978 | 50.58 | 1616000 | 2.5620 |
2.6978 | 50.83 | 1624000 | 2.5749 |
2.6921 | 51.08 | 1632000 | 2.5810 |
2.6921 | 51.33 | 1640000 | 2.5710 |
2.6958 | 51.58 | 1648000 | 2.5627 |
2.6958 | 51.83 | 1656000 | 2.5729 |
2.6909 | 52.08 | 1664000 | 2.5785 |
2.6909 | 52.33 | 1672000 | 2.5725 |
2.6906 | 52.58 | 1680000 | 2.5745 |
2.6906 | 52.83 | 1688000 | 2.5708 |
2.6886 | 53.08 | 1696000 | 2.5379 |
2.6886 | 53.34 | 1704000 | 2.5692 |
2.6931 | 53.59 | 1712000 | 2.5716 |
2.6931 | 53.84 | 1720000 | 2.5474 |
2.6976 | 54.09 | 1728000 | 2.5843 |
2.6976 | 54.34 | 1736000 | 2.5615 |
2.7044 | 54.59 | 1744000 | 2.5678 |
2.7044 | 54.84 | 1752000 | 2.5513 |
2.7076 | 55.09 | 1760000 | 2.5642 |
2.7076 | 55.34 | 1768000 | 2.5533 |
2.6957 | 55.59 | 1776000 | 2.5803 |
2.6957 | 55.84 | 1784000 | 2.5523 |
2.6911 | 56.09 | 1792000 | 2.5769 |
2.6911 | 56.34 | 1800000 | 2.5510 |
2.6949 | 56.59 | 1808000 | 2.5712 |
2.6949 | 56.84 | 1816000 | 2.5696 |
2.6935 | 57.09 | 1824000 | 2.5776 |
2.6935 | 57.34 | 1832000 | 2.5495 |
2.6924 | 57.59 | 1840000 | 2.5555 |
2.6924 | 57.84 | 1848000 | 2.5893 |
2.6992 | 58.09 | 1856000 | 2.5474 |
2.6992 | 58.34 | 1864000 | 2.5591 |
2.6938 | 58.59 | 1872000 | 2.5641 |
2.6938 | 58.84 | 1880000 | 2.5716 |
2.6918 | 59.09 | 1888000 | 2.5481 |
2.6918 | 59.34 | 1896000 | 2.5384 |
2.6927 | 59.59 | 1904000 | 2.5577 |
2.6927 | 59.85 | 1912000 | 2.5693 |
2.6874 | 60.1 | 1920000 | 2.5704 |
2.6874 | 60.35 | 1928000 | 2.5680 |
2.6915 | 60.6 | 1936000 | 2.5578 |
2.6915 | 60.85 | 1944000 | 2.5540 |
2.6942 | 61.1 | 1952000 | 2.5527 |
2.6942 | 61.35 | 1960000 | 2.5956 |
2.7001 | 61.6 | 1968000 | 2.5667 |
2.7001 | 61.85 | 1976000 | 2.5741 |
2.692 | 62.1 | 1984000 | 2.5789 |
2.692 | 62.35 | 1992000 | 2.5476 |
2.6954 | 62.6 | 2000000 | 2.5700 |
2.6954 | 62.85 | 2008000 | 2.5605 |
2.6891 | 63.1 | 2016000 | 2.5873 |
2.6891 | 63.35 | 2024000 | 2.5622 |
2.6903 | 63.6 | 2032000 | 2.5888 |
2.6903 | 63.85 | 2040000 | 2.5678 |
2.6911 | 64.1 | 2048000 | 2.5558 |
2.6911 | 64.35 | 2056000 | 2.5632 |
2.6921 | 64.6 | 2064000 | 2.5564 |
2.6921 | 64.85 | 2072000 | 2.5399 |
2.6842 | 65.1 | 2080000 | 2.5599 |
2.6842 | 65.35 | 2088000 | 2.5642 |
2.6961 | 65.6 | 2096000 | 2.5573 |
2.6961 | 65.85 | 2104000 | 2.5605 |
2.6897 | 66.11 | 2112000 | 2.5627 |
2.6897 | 66.36 | 2120000 | 2.5740 |
2.6929 | 66.61 | 2128000 | 2.5796 |
2.6929 | 66.86 | 2136000 | 2.5580 |
2.699 | 67.11 | 2144000 | 2.5589 |
2.699 | 67.36 | 2152000 | 2.5618 |
2.6923 | 67.61 | 2160000 | 2.5688 |
2.6923 | 67.86 | 2168000 | 2.5876 |
2.6971 | 68.11 | 2176000 | 2.5621 |
2.6971 | 68.36 | 2184000 | 2.5822 |
2.6879 | 68.61 | 2192000 | 2.5695 |
2.6879 | 68.86 | 2200000 | 2.5471 |
2.694 | 69.11 | 2208000 | 2.5567 |
2.694 | 69.36 | 2216000 | 2.5659 |
2.6924 | 69.61 | 2224000 | 2.5781 |
2.6924 | 69.86 | 2232000 | 2.5597 |
2.6904 | 70.11 | 2240000 | 2.5779 |
2.6904 | 70.36 | 2248000 | 2.5693 |
2.6975 | 70.61 | 2256000 | 2.5734 |
2.6975 | 70.86 | 2264000 | 2.5612 |
2.6945 | 71.11 | 2272000 | 2.5453 |
2.6945 | 71.36 | 2280000 | 2.5925 |
2.6922 | 71.61 | 2288000 | 2.5666 |
2.6922 | 71.86 | 2296000 | 2.5671 |
2.6906 | 72.11 | 2304000 | 2.5575 |
2.6906 | 72.37 | 2312000 | 2.5581 |
2.6993 | 72.62 | 2320000 | 2.5700 |
2.6993 | 72.87 | 2328000 | 2.5819 |
2.7053 | 73.12 | 2336000 | 2.5811 |
2.7053 | 73.37 | 2344000 | 2.5717 |
2.6952 | 73.62 | 2352000 | 2.5754 |
2.6952 | 73.87 | 2360000 | 2.5699 |
2.6936 | 74.12 | 2368000 | 2.5752 |
2.6936 | 74.37 | 2376000 | 2.5775 |
2.6962 | 74.62 | 2384000 | 2.5843 |
2.6962 | 74.87 | 2392000 | 2.5677 |
2.6894 | 75.12 | 2400000 | 2.5784 |
Framework versions
- Transformers 4.30.2
- Pytorch 2.0.1+cu117
- Datasets 2.13.1
- Tokenizers 0.13.3