distilbert-mlm-750k

作者 vocab-transformers · 下载 0 · 点赞 0 · 更新 2023-10-31

distilbert-base-uncased trained for 750K steps with batch size 64 on C4, MSMARCO, Wikipedia, S2ORC, News