T5_large_prefix_all_tasks_2upsample2

作者 hkunlp · 下载 0 · 点赞 2 · 更新 2023-10-31

This is the ckpt of prefix-tuning model we trained on 21 tasks using a upsampling temp of 2. Note: The prefix module is large due to the fact we keep the re-param weight and didn't compress it to make it more original and extendable for researchers.