LERT

LERT is a linguistically-motivated pre-trained language model.

Further information: https://github.com/ymcui/LERT/blob/main/README_EN.md

• LERT: A Linguistically-motivated Pre-trained Language Model
• Yiming Cui, Wanxiang Che, Shijin Wang, Ting Liu
• Paper link: https://arxiv.org/abs/2211.05344