intent-classification-korean
fine-tuned for 'klue/roberta-base' used data : 'kor_3i4k'
How to Get Started with the Model
from transformers import TextClassificationPipeline
from transformers import AutoModelForSequenceClassification, AutoTokenizer
model_path = "gg4ever/intent-classifcation-korean"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForSequenceClassification.from_pretrained(model_path)
text_classifier = TextClassificationPipeline(
tokenizer=tokenizer,
model=model.to('cpu'),
return_all_scores=True
)
# predict
text = "이름이 뭐에요?"
preds_list = text_classifier(text)
preds_list
Training Hyperparameters
hyperparameters | values |
---|---|
predict_with_generate | True |
evaluation_strategy | "steps" |
per_device_train_batch_size | 32 |
per_device_eval_batch_size | 32 |
num_train_epochs | 3 |
learning_rate | 4e-5 |
warmup_steps | 1000 |