Overview

ul2-large-japanese is a Japanese version of UL2.

TODOs

• [ ] Documentation
• [x] Pre-training
• [ ] evaluate on downstream tasks
• If you get some experimental results of this model on downstream tasks, please feel free to make Pull Requests.

Results

• Under construction

Question Answering

Others

Acknowledgement

Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC)