Ablation of Lil-Bevo with only short context length for full training period.