Diffusion pretrain script from scratch based on "Denoising Diffusion Probabilistic Models" and "Improved Denoising Diffusion Probabilistic Models" papers. The model was additionally augmented using attention-baced blocks, training method was improved using flash attention.
For example fake face diffusion generator was trained on FFHQ small dataset.
Example of script usage for face diffusion training is here.