RWKV 1.5B for android and iOS

focus on Role play

<strike>should wait for RWKV runner updated to test this model, this model need select customized vocabs file</strike> Runner have updated to be able using selected tokenzier files

image/png

use following txt file to inference and

https://huggingface.co/xiaol/RWKV-claude-for-mobile-v4-world-1.5B-16k/blob/main/rwkv_vocab_v20230424.txt

and use preset to change names to user and assistant which finetuned with this start prefix format details in this image:

image/png

more detail here:https://huggingface.co/xiaol/RWKV-paper-reviewer-and-reading-comprehension-wenda-Worldv4-7B-16k

or you can directly use it on phone make it as your own assistant

https://github.com/daquexian/faster-rwkv

image/png

image/png

temp 0.7 topp 0.4 image/png

image/png

Training details

image/png