textattack_bert_base_MNLI_fixed

作者 chromeNLP · 下载 18 · 点赞 0 · 更新 2023-10-31

Issue_fixed textattack textclassification entailment

Fixed label mapping issue for textattack/bert-base-uncased-MNLI, if using the original model, the predicted label has systematic confusion with the huggingface MNLI dataset. See the Github issue: https://github.com/QData/TextAttack/issues/684. The fixed accuracy_mm is 84.44% and is 7% before the fix applied.