open-llama-7b-code-alpaca-instruct

作者 gvij · 下载 0 · 点赞 0 · 更新 2023-11-02

open-llama llama code instruct instruct-code code-alpaca alpaca-instruct alpaca llama7b

We finetuned Open Llama 7B on Code-Alpaca-Instruct Dataset (ewof/code-alpaca-instruct-unfiltered) for 3 epochs using MonsterAPI no-code LLM finetuner.

This dataset is HuggingFaceH4/CodeAlpaca_20K unfiltered, removing 36 instances of blatant alignment.

The finetuning session got completed in 75 minutes and costed us only $3 for the entire finetuning run!

Loss metrics: training loss