Overview
ul2-base-japanese is a Japanese version of UL2.
TODOs
- [ ] Documentation
- [x] Pre-training
- [ ] evaluate on downstream tasks
- If you get some experimental results of this model on downstream tasks, please feel free to make Pull Requests.
Results
- Under construction
Question Answering
Others
Acknowledgement
Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC)