<h1>data2vec squad</h1> This is a testing fine tuned data2vec model in the squad dataset, any improvements and suggestions are welcome!

<h3>Intended use</h3> Question Answering

<h3>Training results</h3> <table> <thead> <tr> <th>Epoch</th> <th>Training Loss</th> <th>Validation Loss</th> </tr> </thead> <tbody> <tr> <td>1</td> <td><span style="font-family: Roboto, Noto, sans-serif; font-size: 14px; font-style: normal; font-weight: 400; text-align: right;">1.015800</span><br></td> <td><span style="font-family: Roboto, Noto, sans-serif; font-size: 14px; font-style: normal; font-weight: 400; text-align: right;">0.997690</span><br></td> </tr> <tr> <td>2</td> <td><span style="font-family: Roboto, Noto, sans-serif; font-size: 14px; font-style: normal; font-weight: 400; text-align: right;">0.804400</span></td> <td><span style="font-family: Roboto, Noto, sans-serif; font-size: 14px; font-style: normal; font-weight: 400; text-align: right;">0.950322</span><br></td> </tr> </tbody> </table> <h3>Hyperparameters</h3> <ul> <li>evaluation_strategy="epoch"</li> <li>learning_rate=2e-5</li> <li>per_device_train_batch_size=15</li> <li>per_device_eval_batch_size=15</li> <li>num_train_epochs=2</li> <li>weight_decay=0.01</li> </ul>

<h3>Frameworks and libraries used:</h3> <ul> <li>transformers</li> <li>datasets</li> <li>evaluate</li> </ul>