This is electra base tuned with optimal lr, lr scheduler and weight decay on dnd-style-intents dataset.
| parametrs | value |
|---|---|
| learning rate | 5e-5 |
| lr scheduler | linear |
| weight decay | 0 |
Model has next metrics on test data from dataset
| metric | value |
|---|---|
| accuracy | 0.985 |
| Macro F1 | 0.983 |
| Micro F1 | 0.985 |
