LERT

LERT is a linguistically-motivated pre-trained language model.

Further information: https://github.com/ymcui/LERT/blob/main/README_EN.md