A DistilBERT model for Masked Language Modeling (MLM). The base DistilBERT model is initialized from https://huggingface.co/HooshvareLab/distilbert-fa-zwnj-base.

Usage

pip install hezar

from hezar import Model

model = Model.load("hezarai/distilbert-fa-mlm")
inputs = ["ایشالا از [MASK] شروع میکنم"]
outputs = model.predict(inputs)
print(outputs)

{'filled_texts': ['ایشالا از اینجا شروع میکنم'], 'filled_tokens': ['اینجا']}