Fine-tuned model for detecting instances of abusive language in Ducth tweets. The model has been trained with DALC v2.0 .
Abusive language is defined as "Impolite, harsh, or hurtful language (that may contain profanities or vulgar language) that result in a debasement, harassment, threat, or aggression of an individual or a (social) group, but not necessarily of an entity, an institution, an organisations, or a concept." (Ruitenbeek et al., 2022)
The model achieve the following results on multiple test data:
- DALC held-out test set: macro F1: 72.23; F1 Abusive: 51.60
- HateCheck-NL (functional benchmark for hate speech): Accuracy: 60.19; Accuracy non-hateful tests: 57.38 ; Accuracy hateful tests: 59.58
- OP-NL (dynamyc benchmark for offensive language): macro F1: 57.57
More details on the training settings and pre-processind are available here