GHisBERT (German Historical BERT) is a BERT-based model trained from scratch on historical German data, covering all attested stages of the language, i.e., Old High German, Middle High German, Early New High German and New High German, with data going back to 750 CE.

For more details, please see the following paper: [will be added soon...]