Start from sberbank-ai/rugpt3small_based_on_gpt2 and finetuning on Govard Phillips Lovecraft texts (russian).
On this moment - only 1 epoch (perplexity falls reasons)
on progress...
Start from sberbank-ai/rugpt3small_based_on_gpt2 and finetuning on Govard Phillips Lovecraft texts (russian).
On this moment - only 1 epoch (perplexity falls reasons)
on progress...