distilroberta-base fined-tuned on SQuAD (https://huggingface.co/datasets/squad)

Hyperparameters:

• epochs: 1
• lr: 1e-5
• train batch sie: 16
• optimizer: adamW
• lr_scheduler: linear
• num warming steps: 0
• max_length: 512

Results on the dev set:

• 'exact_match': 76.37653736991486
• 'f1': 84.5528918750732

It took 1h 20 min to train on Colab.