Fashion MNIST unconditional Unet Model trained using DDPM

Model Hyperparams:

• Model size: 51,834,625 params
• 3 stages: 128, 256, 512 channels
• Linear Attention in 2nd and 3rd stages, Self Attention in Middle Stage
• Optimizer: Adam
• LR: 3e-4
• Batch Size: 64
• Grad Accumulation: 8 steps
• Effectibe Batch Size: 512
• Total steps: 5,000
• Linear Beta Schedule: 1000 Steps