Requires a custom version of the transformers library to run which can be installed with pip install "git+https://github.com/bigcode-project/transformers.git@sc2-ablations"