thu-ml/unidiffuser

This is stars and forks stats for /thu-ml/unidiffuser repository. As of 23 Apr, 2024 this repository has 1117 stars and 69 forks.

UniDiffuser Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion" UniDiffuser is a unified diffusion framework to fit all distributions relevant to a set of multi-modal data in one model. Its key insight is -- learning diffusion models for marginal, conditional, and joint distributions can be unified as predicting the noise in the perturbed data, where the perturbation levels (i.e. timesteps) can be different for different modalities. Inspired by the unified...