Thanks for checking this out! <br /> This video explains the ideas behind KerasBERT (still very much a work in progress) https://www.youtube.com/watch?v=J3P8WLAELqk