See https://www.kaggle.com/code/dima806/t5-summarization-with-proximal-policy-optimization for more details.