text2text-generation Guyanese Creole Caribbean dialect

Guyanese English Creole to English Translator

This model utilises T5-base pre-trained model. It was fine tuned using a custom dataset for translation of Guyanese English Creole to English. This model will be updated periodically as more data is compiled. For more on the Caribbean English Creoles checkout the library Caribe.


Usage with Transformers

from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("KES/GEC-English")
model = AutoModelForSeq2SeqLM.from_pretrained("KES/GEC-English")
text = "Ah waan ah phone"
inputs = tokenizer("guy:"+text, truncation=True, return_tensors='pt')
output = model.generate(inputs['input_ids'], num_beams=4, max_length=512, early_stopping=True)
translation=tokenizer.batch_decode(output, skip_special_tokens=True)
print("".join(translation)) #translation: I want a phone.