Model

"bigscience/bloomz-560m"

Dataset

"Abirate/english_quotes" (English quotes)

Training procedure

Prompt tuning using random soft prompts (virtual tokens).

For the PEFT configuration, the following parameter was used: num_virtual_tokens=4

trainable params: 4,096 || all params: 559,218,688 || trainable%: 0.0007324504863471229

Framework versions