indochat-tiny

作者 cahya · 下载 32 · 点赞 0 · 更新 2023-11-01

text generation pytorch causal-lm

IndoChat-Tiny

This model is a bilingual GPT2 model fine-tuned with instructions dataset (~100K English instructions and its ~100K Indonesian translation). The base model was a GPT2-Medium (345M params) which was pretrained with 75GB of Indonesian (99%) and English (1%) dataset.