Flow Straight and Fast: A Simple and Unified Approach to Generative Modeling, Domain Transfer, and Optimal Transport

2022年09月23日

We consider the problem of learning a transport mapping between two distributions that are only observed through unpaired data points. This problem provides a unified framework for a variety of fundamental tasks in machine learning: generative modeling is about transforming a Gaussian (or other elementary) random variable to realistic data points; domain transfer concerns with transferring data points from one domain to another; optimal transport (OT) solves the more challenging problem of finding a "best" transport map that minimizes certain transport cost. Unfortunately, despite the unified view, there lacks an algorithm that can solve the transport mapping problem efficiently in all settings. The existing algorithms need to be developed case by case, and tend to be complicated or computationally expensive.

In this talk, I will show you that the problem can be addressed with a simple and unified algorithm by learning neural ordinary differential equations (ODEs) and stochastic differential equations (SDEs). One of the key ideas is to learn dynamics to efficient transfer between two distributions by traveling along straight paths as much as possible. These methods both simplify and improve over the standard denoising diffusion models: the ODE models learned by our method generate can high quality results with a single discretization step, which is a significant speedup over existing diffusion generative models. I will highlight the applications in molecule generation and antibody design.