lucidrains/make-a-video-pytorch

This is stars and forks stats for /lucidrains/make-a-video-pytorch repository. As of 29 Apr, 2024 this repository has 1684 stars and 153 forks.

Make-A-Video - Pytorch (wip) Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch. They combine pseudo-3d convolutions (axial convolutions) and temporal attention and show much better temporal fusion. The pseudo-3d convolutions isn't a new concept. It has been explored before in other contexts, say for protein contact prediction as "dimensional hybrid residual networks". The gist of the paper comes down to, take a SOTA text-to-image model (here they use DALL-E2,...