roberta-large-pile-lr2e-5-bs16-8gpu-1700000

作者 socialfoundations · 下载 0 · 点赞 0 · 更新 2023-11-02

Standard roberta-large model fine-tuned for one pass over the entire Pile dataset.

See Test-time training on nearest neighbors for large language models for details.