Image Synthesis

less than 1 minute read

Published:

βœ… -> finished reading ❌ -> not yet finished reading

Diffusion

Understanding Diffusion Models: A Unified Perspective from Calvin Luo. βœ…

  • Detailed formula derivation for Denoising Diffusion Probabilistic Model (DDPM) and Variational Diffusion Model (VDM)

  • Connection between VDM and score-based generative models

  • Conditional generation (Classifier Guidance and Classifier-free Guidance)

What are Diffusion Models? from Lilian Weng.

  • DDPM βœ…
  • DDIM ❌
  • Diffusion Speed-up: Progressive Distillation ❌ , Consistency Models ❌ , LDM βœ…
  • Scale-up Generation: Cascaded Diffusion Models βœ…, unCLIP ❌
  • Model Architecture: U-Net βœ…, ControlNet ❌ , DiT βœ…

Generative Modeling by Estimating Gradients of the Data Distribution from Yang Song.

  • Naive score-based generative modeling and its pitfalls βœ…
  • Score-based generative modeling with multiple noise perturbations βœ…
  • Score-based generative modeling with stochastic differential equations (SDEs) ❌