This model is a Pytorch version of uklfr/gottbert-base. All credits to their developers.