This repository contains the models used in the experiments of git repository. There are 3 versions of the model, corresponding to different finetuning runs from the base model, EleutherAI/pythia-410m:

• v1697154033
• v1697125056
• v1697182445

The main branch contains v1697154033, and other versions can be loaded as follows:

version = "v1697182445"
name = "EleutherAI/quirky-math-410m"
model = AutoModelForCausalLM.from_pretrained(name, revision=version)
tokenizer = AutoTokenizer.from_pretrained(name, revision=version)