Transformer language model for Croatian and Serbian
Trained on 6GB datasets that contain Croatian and Serbian language for two epochs (500k steps). Leipzig, OSCAR and srWac datasets
| Model | #params | Arch. | Training data |
|---|---|---|---|
Andrija/SRoBERTa-L |
80M | Third | Leipzig Corpus, OSCAR and srWac (6 GB of text) |