llama-lite-134m

作者 skeskinen · 下载 222 · 点赞 9 · 更新 2023-11-02

134m parameter, 768 width version of Llama for creating sentence embeddings

https://github.com/skeskinen/llama-lite

Currently trained on just the alpaca dataset, but might contain better weights later.