Model Card
Shared by : Sirinoot Ketkham
Model Name : WangchanBERTa QA Fine-tuned
Model ID: wangchanberta-qa-finetuned
Model type: chatbot for question-answering
Language(s) (NLP): th
Finetuned from model : wangchanberta-base-att-spm-uncased.
Model Details
Model Description
The WangchanBERTa QA Fine-tuned model is a Thai question-answering model that has been fine-tuned from the base model, WangchanBERTa, using the Thai QA corpus dataset. The model has been trained to understand and answer questions in Thai based on the given context. It is suitable for various question-answering tasks in the Thai language.
The model is based on the transformer architecture and has been fine-tuned using a training regime with a batch size of 32 and trained for 7 epochs. The training process utilized the Thai QA corpus dataset, which consists of approximately 17,000 question-answer pairs.nswer pairs. for study and research purposes only.
Speeds, Times
Due to the limited size of the training dataset, consisting of only 17,000 question-answer pairs, and the relatively low number of training epochs set to 7, the training process is completed within a relatively short time frame of approximately 13 minutes.
It is essential to review and thoroughly understand the model's outputs before relying on them for critical or sensitive tasks. Regular monitoring and evaluation of the model's performance and ethical implications are recommended.
Evaluation
Metrics
| Metric | Score |
|---|---|
| Accuracy | 0.924 |
| Precision | 0.958 |
| Recall | 0.954 |
| F1 Score | 0.914 |
| ROUGE-1 Score | 0.928 |
| ROUGE-2 Score | 0.529 |
| ROUGE-L Score | 0.928 |
| BLEURT Score | 0.830 |
| BLEU Score | 0.917 |
Model Examination
-
Context: ประเทศเวเนซุเอลาตั้งอยู่ในทวีปใด อเมริกาใต้
Question: ประเทศเวเนซุเอลาตั้งอยู่ในทวีปใด -
Context: บิดาของหม่อมงามจิตต์ บุรฉัตร ณ อยุธยา คือใคร พันโท พระสารสาสน์พลขันธ์
Question: บิดาของหม่อมงามจิตต์ บุรฉัตร ณ อยุธยา คือใคร -
Context: นวนิยายแฟนตาซีเกี่ยวกับแวมไพร์ชื่อ แรกรัตติกาล หรือ Twilight ประพันธ์โดยใคร สเตเฟนี เมเยอร์
Question: นวนิยายแฟนตาซีเกี่ยวกับแวมไพร์ชื่อ แรกรัตติกาล หรือ Twilight ประพันธ์โดยใคร
References
Please note that the base model, WangchanBERTa, was developed by the AI Research (AIR) team at Thai NLP and can be accessed at the following GitHub repository: https://github.com/vistec-AI/thai2transformers.
For further details, documentation, and updates, please refer to the model's GitHub repository and the Thai NLP community resources.