Word-embedding layer stolen from a LLaMA 13B model. The vocab size is 32K.