Towards demystifying the creativity of diffusion models
A Google Research ICLR 2026 paper traces diffusion model creativity to score smoothing from regularisation such as weight decay. Smoother learned score functions let denoising interpolate between training points, generating new samples rather than simply memorising them.