ntk_scaled_llama_7b_16k

作者 kz919 · 下载 0 · 点赞 0 · 更新 2023-11-03

Modified Llama-7B to 16k out of box (without finetuning) following the ntk-scaling recipe from this reddit thread.