Modified Open-Llama-7B to 4k out of box (without finetuning) following the ntk-scaling recipe from this reddit thread.