gpt text-generation

Keras Implementation of Text generation with a miniature GPT

This repo contains the model and the notebook to this Keras example on Text generation with a miniature GPT.

Full credits to: fchollet

Background Information

This example demonstrates how to implement text generation with a miniature GPT model. The model consists of a single Transformer block with causal masking in its attention layer.

Datasets

IMDB sentiment classification dataset for training. The model generates new movie reviews for a given prompt.