roberta-base-ko
A roberta model trained from the scratch. It has almost the same structure as roberta-base, but with a few differences.
- hidden_act:
mish - position_embedding_type:
relative_key_query
A roberta model trained from the scratch. It has almost the same structure as roberta-base, but with a few differences.
mishrelative_key_query