generated_from_trainer

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

metal-graphcodebert-base-ls-ibn-only

This model is a fine-tuned version of on the None dataset. It achieves the following results on the evaluation set:

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

Training results

Training Loss Epoch Step Validation Loss Accuracy Text Start Acc Text End Acc Code Start Acc Code End Acc
7.8216 0.02 100 6.3646 0.4383 0.0967 0.0824 0.5838 0.5838
6.3558 0.04 200 6.1232 0.4558 0.1879 0.1014 0.5844 0.5868
6.0508 0.06 300 5.9067 0.4745 0.2566 0.1787 0.5792 0.5841
5.7169 0.08 400 5.7086 0.5068 0.3118 0.2549 0.6036 0.5963
5.2796 0.1 500 5.6544 0.5032 0.3594 0.3135 0.5701 0.5753
4.8897 0.12 600 5.5094 0.5276 0.4190 0.3496 0.5943 0.5804
4.6792 0.14 700 5.6578 0.4949 0.4401 0.3540 0.5388 0.5326
4.574 0.16 800 5.6680 0.5019 0.4700 0.4095 0.5182 0.5374
4.3534 0.19 900 5.5330 0.5244 0.4997 0.4442 0.5278 0.5648
4.201 0.21 1000 5.4205 0.5587 0.5317 0.4881 0.5677 0.5905
4.0547 0.23 1100 5.5041 0.5363 0.5905 0.5204 0.5211 0.5356
3.9951 0.25 1200 5.5359 0.5534 0.6181 0.5609 0.5543 0.5224
3.8484 0.27 1300 5.3455 0.5927 0.6590 0.5875 0.5762 0.5838
3.7509 0.29 1400 5.4124 0.5775 0.6654 0.6038 0.5627 0.5447
3.7636 0.31 1500 5.3803 0.6136 0.7005 0.6161 0.6095 0.5803
3.628 0.33 1600 5.4425 0.5827 0.6869 0.6321 0.5554 0.5458
3.5948 0.35 1700 5.6139 0.5801 0.7195 0.6705 0.5404 0.5239
3.5385 0.37 1800 5.4402 0.6062 0.7195 0.6651 0.5904 0.5502
3.4596 0.39 1900 5.2674 0.6622 0.7631 0.7066 0.6355 0.6281
3.4023 0.41 2000 5.1996 0.6666 0.7509 0.7073 0.6453 0.6357
3.3846 0.43 2100 5.4084 0.6380 0.7737 0.7209 0.5952 0.5895
3.3297 0.45 2200 5.4272 0.6569 0.7730 0.7263 0.6279 0.6085
3.3595 0.47 2300 5.4141 0.6810 0.7682 0.7029 0.6683 0.6483
3.2601 0.49 2400 5.3889 0.6915 0.7886 0.7332 0.6638 0.6612
3.3156 0.51 2500 5.2700 0.6973 0.7859 0.7543 0.6781 0.6558
3.2684 0.53 2600 5.4825 0.6572 0.7961 0.7423 0.6210 0.5999
3.2223 0.56 2700 5.2294 0.7173 0.7999 0.7590 0.7064 0.6764
3.2075 0.58 2800 5.6068 0.6438 0.8060 0.7621 0.5911 0.5794
3.1967 0.6 2900 5.3164 0.6852 0.7995 0.7570 0.6501 0.6425
3.1862 0.62 3000 5.6059 0.6510 0.8230 0.7815 0.5865 0.5894
3.1539 0.64 3100 5.2614 0.7168 0.8176 0.7658 0.7033 0.6678
3.1001 0.66 3200 5.5935 0.6667 0.8189 0.7682 0.6271 0.6003
3.1314 0.68 3300 5.5851 0.6827 0.8295 0.7856 0.6449 0.6165
3.0924 0.7 3400 5.3326 0.7068 0.8216 0.7634 0.6741 0.6680
3.0825 0.72 3500 5.4707 0.6857 0.8230 0.7856 0.6538 0.6185
3.0767 0.74 3600 5.1901 0.7364 0.8383 0.7788 0.7125 0.7003
3.0618 0.76 3700 5.4863 0.6890 0.8319 0.7828 0.6619 0.6172
3.0166 0.78 3800 5.3479 0.7308 0.8302 0.7934 0.7101 0.6841
3.0111 0.8 3900 5.5386 0.6799 0.8312 0.7968 0.6239 0.6242
3.0172 0.82 4000 5.3829 0.7130 0.8349 0.7985 0.6852 0.6541
2.9713 0.84 4100 5.4616 0.7074 0.8288 0.7869 0.6702 0.6609
2.9885 0.86 4200 5.3069 0.7394 0.8404 0.7975 0.7104 0.7020
2.99 0.88 4300 5.6059 0.6981 0.8479 0.8063 0.6605 0.6280
2.9695 0.9 4400 5.2023 0.7438 0.8465 0.8039 0.7302 0.6895
2.9408 0.93 4500 5.4110 0.7148 0.8353 0.7764 0.6845 0.6690
2.9897 0.95 4600 5.4082 0.7059 0.8393 0.7907 0.6661 0.6548
2.9272 0.97 4700 5.6034 0.7008 0.8404 0.8022 0.6641 0.6371
2.8985 0.99 4800 5.3913 0.7160 0.8468 0.8074 0.6837 0.6557
2.8482 1.01 4900 5.4566 0.7213 0.8502 0.8050 0.6905 0.6635
2.8106 1.03 5000 5.4727 0.7278 0.8465 0.8189 0.6947 0.6733
2.8389 1.05 5100 5.3628 0.7390 0.8400 0.8155 0.7265 0.6774
2.7929 1.07 5200 5.2926 0.7559 0.8410 0.8114 0.7349 0.7183
2.7717 1.09 5300 5.3536 0.7430 0.8428 0.8074 0.7132 0.7044
2.8309 1.11 5400 5.4982 0.7359 0.8363 0.7995 0.7157 0.6878
2.7942 1.13 5500 5.3597 0.7445 0.8451 0.8063 0.7245 0.6967
2.7829 1.15 5600 5.5317 0.7325 0.8438 0.8142 0.7143 0.6702
2.7695 1.17 5700 5.3314 0.7678 0.8598 0.8155 0.7579 0.7193
2.7708 1.19 5800 5.4218 0.7390 0.8526 0.8060 0.7148 0.6878
2.7922 1.21 5900 5.4157 0.7420 0.8475 0.8179 0.7180 0.6903
2.7567 1.23 6000 5.4147 0.7497 0.8567 0.8240 0.7233 0.7004
2.7675 1.25 6100 5.4131 0.7537 0.8581 0.8319 0.7402 0.6910
2.7764 1.27 6200 5.3873 0.7501 0.8625 0.8274 0.7082 0.7129
2.7573 1.3 6300 5.5479 0.7249 0.8581 0.8237 0.6741 0.6790
2.77 1.32 6400 5.5194 0.7247 0.8581 0.8237 0.6825 0.6700
2.7233 1.34 6500 5.3616 0.7584 0.8533 0.8162 0.7412 0.7119
2.7425 1.36 6600 5.4828 0.7265 0.8570 0.8247 0.6913 0.6662
2.7307 1.38 6700 5.2346 0.7764 0.8604 0.8199 0.7617 0.7379
2.726 1.4 6800 5.2884 0.7751 0.8622 0.8244 0.7627 0.7307
2.7359 1.42 6900 5.2998 0.7657 0.8608 0.8257 0.7362 0.7304
2.737 1.44 7000 5.4230 0.7446 0.8625 0.8220 0.7166 0.6912
2.7157 1.46 7100 5.4631 0.7475 0.8519 0.8281 0.7288 0.6891
2.7361 1.48 7200 5.5438 0.7331 0.8683 0.8325 0.6886 0.6797
2.7007 1.5 7300 5.4283 0.7472 0.8625 0.8346 0.7177 0.6922
2.7003 1.52 7400 5.5048 0.7384 0.8652 0.8179 0.7058 0.6848
2.7237 1.54 7500 5.4294 0.7652 0.8560 0.8366 0.7446 0.7180
2.6803 1.56 7600 5.4525 0.7538 0.8604 0.8182 0.7298 0.7065
2.689 1.58 7700 5.5552 0.7426 0.8591 0.8302 0.7106 0.6895
2.7019 1.6 7800 5.4872 0.7570 0.8639 0.8387 0.7339 0.7015
2.7033 1.62 7900 5.3368 0.7593 0.8673 0.8366 0.7331 0.7084
2.6944 1.64 8000 5.4693 0.7504 0.8618 0.8312 0.7169 0.7037
2.689 1.67 8100 5.4700 0.7630 0.8639 0.8332 0.7413 0.7133
2.6765 1.69 8200 5.4433 0.7703 0.8690 0.8288 0.7480 0.7271
2.6535 1.71 8300 5.3406 0.7759 0.8652 0.8165 0.7667 0.7309
2.6437 1.73 8400 5.5779 0.7390 0.8635 0.8220 0.7065 0.6849
2.664 1.75 8500 5.5064 0.7378 0.8639 0.8254 0.7182 0.6683
2.6683 1.77 8600 5.3742 0.7748 0.8615 0.8233 0.7571 0.7360
2.6752 1.79 8700 5.5185 0.7537 0.8669 0.8251 0.7287 0.7018
2.6432 1.81 8800 5.4709 0.7680 0.8642 0.8281 0.7529 0.7177
2.6465 1.83 8900 5.6372 0.7436 0.8615 0.8251 0.7177 0.6862
2.6388 1.85 9000 5.4166 0.7579 0.8567 0.8285 0.7412 0.7040
2.6946 1.87 9100 5.3870 0.7670 0.8676 0.8315 0.7413 0.7237
2.628 1.89 9200 5.5029 0.7608 0.8710 0.8322 0.7295 0.7165
2.6517 1.91 9300 5.4448 0.7805 0.8724 0.8410 0.7626 0.7349
2.6379 1.93 9400 5.4567 0.7554 0.8683 0.8414 0.7332 0.6947
2.6201 1.95 9500 5.4436 0.7641 0.8700 0.8400 0.7353 0.7169
2.6512 1.97 9600 5.4353 0.7686 0.8751 0.8346 0.7531 0.7122
2.6727 1.99 9700 5.2713 0.7946 0.8761 0.8373 0.7779 0.7595
2.554 2.01 9800 5.3572 0.7839 0.8754 0.8434 0.7612 0.7437
2.5699 2.04 9900 5.4009 0.7846 0.8747 0.8414 0.7644 0.7434
2.5355 2.06 10000 5.4402 0.7713 0.8788 0.8479 0.7439 0.7220
2.5418 2.08 10100 5.4777 0.7747 0.8775 0.8417 0.7497 0.7290
2.5556 2.1 10200 5.3495 0.7935 0.8785 0.8434 0.7652 0.7656
2.5377 2.12 10300 5.4149 0.7840 0.8799 0.8482 0.7643 0.7369
2.5699 2.14 10400 5.3084 0.7955 0.8730 0.8393 0.7850 0.7554
2.5618 2.16 10500 5.3421 0.7934 0.8788 0.8445 0.7775 0.7524
2.5152 2.18 10600 5.3463 0.7903 0.8696 0.8356 0.7791 0.7495
2.5413 2.2 10700 5.3624 0.7868 0.8707 0.8325 0.7714 0.7481
2.504 2.22 10800 5.4430 0.7808 0.8768 0.8356 0.7572 0.7414
2.5583 2.24 10900 5.3649 0.7884 0.8741 0.8359 0.7662 0.7551
2.5226 2.26 11000 5.4187 0.7750 0.8747 0.8404 0.7505 0.7305
2.5005 2.28 11100 5.4055 0.7846 0.8683 0.8407 0.7598 0.7512
2.5318 2.3 11200 5.4318 0.7783 0.8713 0.8410 0.7615 0.7301
2.536 2.32 11300 5.3246 0.7954 0.8713 0.8407 0.7772 0.7629
2.5451 2.34 11400 5.3373 0.7929 0.8717 0.8506 0.7812 0.7476
2.5074 2.36 11500 5.3783 0.7906 0.8713 0.8431 0.7742 0.7512
2.5224 2.38 11600 5.3735 0.7871 0.8717 0.8445 0.7588 0.7562
2.5149 2.41 11700 5.3319 0.7998 0.8795 0.8489 0.7846 0.7613
2.5389 2.43 11800 5.2504 0.8056 0.8727 0.8448 0.7991 0.7679
2.5119 2.45 11900 5.5226 0.7681 0.8730 0.8417 0.7399 0.7219
2.5234 2.47 12000 5.3983 0.7891 0.8737 0.8434 0.7669 0.7534
2.5182 2.49 12100 5.3814 0.7930 0.8724 0.8441 0.7796 0.7520
2.5245 2.51 12200 5.3952 0.7890 0.8741 0.8431 0.7728 0.7471
2.5119 2.53 12300 5.4067 0.7850 0.8758 0.8472 0.7608 0.7456
2.5215 2.55 12400 5.4097 0.7864 0.8727 0.8458 0.7613 0.7507
2.5127 2.57 12500 5.3509 0.7873 0.8703 0.8424 0.7777 0.7395
2.5046 2.59 12600 5.2962 0.8001 0.8737 0.8431 0.7796 0.7720
2.4837 2.61 12700 5.4046 0.7884 0.8737 0.8438 0.7752 0.7429
2.5137 2.63 12800 5.3183 0.7980 0.8741 0.8448 0.7806 0.7640
2.515 2.65 12900 5.3201 0.7992 0.8724 0.8489 0.7803 0.7667
2.5306 2.67 13000 5.3706 0.7950 0.8754 0.8428 0.7842 0.7522
2.4889 2.69 13100 5.3895 0.7903 0.8758 0.8424 0.7755 0.7476
2.5178 2.71 13200 5.3558 0.7974 0.8720 0.8407 0.7832 0.7625
2.5057 2.73 13300 5.3839 0.7913 0.8747 0.8438 0.7785 0.7474
2.522 2.75 13400 5.3373 0.7978 0.8734 0.8434 0.7839 0.7610
2.4612 2.78 13500 5.3752 0.7937 0.8744 0.8434 0.7801 0.7528
2.5035 2.8 13600 5.3719 0.7953 0.8778 0.8465 0.7822 0.7525
2.4851 2.82 13700 5.3599 0.7987 0.8754 0.8455 0.7816 0.7643
2.5165 2.84 13800 5.3383 0.8005 0.8764 0.8451 0.7872 0.7636
2.5382 2.86 13900 5.3440 0.7980 0.8747 0.8431 0.7806 0.7646
2.4977 2.88 14000 5.3545 0.7973 0.8751 0.8448 0.7819 0.7603
2.4886 2.9 14100 5.3799 0.7930 0.8747 0.8421 0.7759 0.7554
2.5048 2.92 14200 5.3314 0.7994 0.8741 0.8441 0.7846 0.7644
2.4761 2.94 14300 5.3567 0.7949 0.8747 0.8431 0.7796 0.7568
2.5016 2.96 14400 5.3700 0.7940 0.8754 0.8455 0.7794 0.7532
2.4906 2.98 14500 5.3607 0.7950 0.8751 0.8462 0.7799 0.7554

Framework versions