Image Synthesis

less than 1 minute read

Published:

✅ -> finished reading ❌ -> not yet finished reading

Diffusion

Understanding Diffusion Models: A Unified Perspective from Calvin Luo. ✅

  • Detailed formula derivation for Denoising Diffusion Probabilistic Model (DDPM) and Variational Diffusion Model (VDM)

  • Connection between VDM and score-based generative models

  • Conditional generation (Classifier Guidance and Classifier-free Guidance)

What are Diffusion Models? from Lilian Weng.

  • DDPM ✅
  • DDIM ❌
  • Diffusion Speed-up: Progressive Distillation ❌ , Consistency Models ❌ , LDM ✅
  • Scale-up Generation: Cascaded Diffusion Models ✅, unCLIP ❌
  • Model Architecture: U-Net ✅, ControlNet ❌ , DiT ✅

Generative Modeling by Estimating Gradients of the Data Distribution from Yang Song.

  • Naive score-based generative modeling and its pitfalls ✅
  • Score-based generative modeling with multiple noise perturbations ✅
  • Score-based generative modeling with stochastic differential equations (SDEs) ❌