masked-lm pytorch

BERT for Patents

BERT for Patents is a model trained by Google on 100M+ patents (not just US patents). It is based on BERT<sub>LARGE</sub>.

If you want to learn more about the model, check out the blog post, white paper and GitHub page containing the original TensorFlow checkpoint.


Projects using this model (or variants of it):