Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->
- Developed by: Farid Haziyev
- Model type: Tokenizer
- Language(s) (NLP): Azerbaijani
- License: MIT
- Finetuned from model [optional]: bert-based-uncased
Uses
Can be used in any project intended for the purpose of improving Azerbaijani language models
How to Get Started with the Model
Use the code below to get started with the model.
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("heziyevv/aze-bert-tokenizer-middle")