ggml files
The files in this repository are LLM (Large Language Model) models converted to ggml format. See the original repository below for copyright. files...
- line-corporation/japanese-large-lm-3.6b
- cyberagent/open-calm
Original repositories
- https://huggingface.co/cyberagent/open-calm-3b
- https://huggingface.co/cyberagent/open-calm-7b
- https://huggingface.co/line-corporation/japanese-large-lm-3.6b
- https://huggingface.co/line-corporation/japanese-large-lm-3.6b-instruction-sft
Usage
Download ggml file
Install ggml
Install ggml commands.
git clone https://github.com/ggerganov/ggml.git
cd ggml && mkdir -p build && cd build && cmake .. && make -j
Ask question
./ggml/build/bin/gpt-neox \
-m ./line-jp-3.6b-instruction-sft-f16.bin \
-p "世界で一番高い山は"
reference
- https://note.com/kujirahand/n/nd273e1edcb1f
- https://zenn.dev/kujirahand/articles/dc7f7b0e285ecd