This model uses an unsupervised sentence encoder proposed by Liu et al. (2021) to create better sentence representations for the SPECTER transformer model.