T5-ANCE
T5-ANCE generally follows the training procedure described in this page, but uses a much larger batch size.
Dataset used for training:
- MS MARCO Passage
Evaluation result:
| Dataset | Metric | Result |
|---|---|---|
| MS MARCO Passage (dev) | MRR@10 | 0.3570 |
Important hyper-parameters:
| Name | Value |
|---|---|
| Global batch size | 256 |
| Learning rate | 5e-6 |
| Maximum length of query | 32 |
| Maximum length of document | 128 |
| Template for query | <text> |
| Template for document | Title: <title> Text: <text> |
Paper
-
