Nystromformer for sequence length 1024 trained on WikiText-103 v1 for 150 epochs.