Initialized from first 3 layers of Llama2-13B.