generated_from_trainer

bart-base-spelling-nl

This model is a Dutch fine-tuned version of facebook/bart-base.

It achieves the following results on an external evaluation set of human-corrected spelling errors of Dutch snippets of internet text (errors and corrections, run spell.py)

Note that it is very hard for any spelling corrector to clean more actual spelling errors than introducing new errors. In other words, most spelling correctors cannot be run automatically and must be used interactively.

These are the upper-bound scores when correcting nothing. In other words, this is the actual distance between the errors and their corrections in the evaluation set:

We are not there yet, clearly.

Model description

This is a fine-tuned version of facebook/bart-base trained on spelling correction. It leans on the excellent work by Oliver Guhr (github, huggingface). Training was performed on an AWS EC2 instance (g5.xlarge) on a single GPU, and took about two days.

Intended uses & limitations

The intended use for this model is to be a component of the Valkuil.net context-sensitive spelling checker.

Training and evaluation data

The model was trained on a Dutch dataset composed of 12,351,203 lines of text, containing a total of 123,131,153 words, from three public Dutch sources, downloaded from the Opus corpus:

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

Framework versions