Text-to-video model: Difference between revisions

Revision as of 10:44, 30 June 2025

Revision as of 10:46, 30 June 2025

Line 1:

{{Short description|Machine learning model}}

{{Use dmy dates|date=November 2024}}

[[File:OpenAI Sora in Action- Tokyo Walk.webm|thumb|upright=1.35|A video generated using OpenAI's [[Sora (text-to-video model)|Sora]] text-to-video model, using the prompt: <code>A clever-lookingstylish catwoman withwalks sleekdown fura watchesTokyo asstreet afilled clumsywith dogwarm slipsglowing onneon aand smoothanimated woodencity floorsignage. TheShe scenewears isa capturedblack inleather jacket, a lifelike,long realisticred styledress, withand naturalblack lightingboots, and detailedcarries fura texturesblack purse. InShe thewears nextsunglasses moment,and thered catlipstick. standsShe victoriouswalks afterconfidently aand playfulcasually. scuffle,The holdingstreet upis adamp realisticand goldenreflective, trophycreating witha pride,mirror itseffect eyesof gleamingthe withcolorful triumphlights. TheMany backgroundpedestrians is a cozy living room with soft shadows and warmwalk tonesabout.</code>]]

A '''text-to-video model''' is a [[machine learning model]] that uses a [[natural language]] description as input to produce a [[video]] relevant to the input text.<ref name="AIIR">{{cite report|url=https://aiindex.stanford.edu/wp-content/uploads/2023/04/HAI_AI-Index-Report_2023.pdf|title=Artificial Intelligence Index Report 2023|publisher=Stanford Institute for Human-Centered Artificial Intelligence|page=98|quote=Multiple high quality text-to-video models, AI systems that can generate video clips from prompted text, were released in 2022.}}</ref> Advancements during the 2020s in the generation of high-quality, text-conditioned videos have largely been driven by the development of video [[diffusion model]]s.<ref>{{cite arXiv |last1=Melnik |first1=Andrew |title=Video Diffusion Models: A Survey |date=2024-05-06 |eprint =2405.03150 |last2=Ljubljanac |first2=Michal |last3=Lu |first3=Cong |last4=Yan |first4=Qi |last5=Ren |first5=Weiming |last6=Ritter |first6=Helge|class=cs.CV }}</ref>