My second try at training. Same idea as my first run, falcon-40b with oasst1 dataset.

Did some weird things with putting a suffix after the input sequence.

Had a play with MLflow.

Ran on 1xH100 this time to compare to the A100 experience.

Very much an experiment, use at your own risk!