ntk_scaled_open_llama_3b_8k

作者 kz919 · 下载 0 · 点赞 0 · 更新 2023-11-03

Modified Open-Llama-3B to 8k out of box (without finetuning) following the ntk-scaling recipe from this reddit thread.