My first try at just about everything, including training and uploading to HuggingFace.

I got interested in trying this out on a small budget when I heard about QLoRA and that Falcon was changed to ASL license.

It was very much an experiment, so use at your own risk!