This model is a version of distilbert-base-uncased, which is fine-tuned using MLM on ml-arxiv-papers dataset.