bert-italian-xxl-cased_squad-it_v1

BERT-based model for extractive Question-Answering.

Model Details

Model Description

• Developed by: fabgraziano
• Model type: Question-Answering
• Language(s) (NLP): Italian
• Finetuned from model: dbmdz/bert-base-italian-xxl-cased
• Datased used: squad_it

Training Details

Training Hyperparameters

• Training regime: fp16 mixed precision
• MAX_LENGTH: 384
• STRIDE: 128
• BATCH_SIZE: 8
• LEARNING_RATE: 2e-5
• EPOCHS: 3

Evaluation

Metrics

• EM: 63.87
• F1: 75.34