PMC pretrained RoBERTa large model
Pretrained on PMC fulltext paragraphs on masked language modeling task, it's mostly biology/ medical papers
Pretrained on PMC fulltext paragraphs on masked language modeling task, it's mostly biology/ medical papers