deprecated_bf16_LLaMA2_13B_with_EOT_token

作者 imone · 下载 48 · 点赞 1 · 更新 2023-11-03

Llama 2 13B with End-of-turn (EOT) Token

This is the Llama 2 13B model with <|end_of_turn|> token added as id 32000 and <|PAD|> as id 32001. The token input/output embedding is initialized as the mean of all existing input/output token embeddings, respectively.