According to a research paper published by Google Research, the team has developed a space-time diffusion model called “Lumiere”. This model also serves as an AI-powered tool for converting text into videos. It claims to be able to consider spatial and temporal motion concepts when generating videos, in order to create consistent and smooth dynamic images.
Google unveils Lumiere, AI model for transforming text and images into videos with customizable visual styles