LLaMA 13B with End-of-turn (EOT) Token
This is the LLaMA 13B model with <|end_of_turn|> token added as id 32000. The token input/output embedding is initialized as the mean of all existing input/output token embeddings, respectively.
This is the LLaMA 13B model with <|end_of_turn|> token added as id 32000. The token input/output embedding is initialized as the mean of all existing input/output token embeddings, respectively.