See the https://dima806.substack.com/p/using-distilbert-transformer-for-writing-engaging-titles-on-medium-b75f30f1f80e and https://www.kaggle.com/code/dima806/distilbert-transformers-for-engaging-titles for more details