ReadMe

This is a pretrained model based on gpt2 that has been trained on copenlu/answerable_tydiqa, specifically the text field of the English samples for 2 epochs.

To use the pretrained head, use: AutoModelForCausalLM.from_pretrained.

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("PartiallyTyped/answerable_tydiqa_lm_pretrained_japenese")
tokenizer = AutoTokenizer.from_pretrained("rinna/japanese-gpt2-small")