1. Home
  2. Newsletter
  3. Daily
  4. šŸ˜ŗ NEW from OpenAI
newsletter icon
The Leaderboard
Monday through Friday
NEW from OpenAI
PRODUCT HIGHLIGHT
OpenAIā€™s latest model takes video generation to the next level

OpenAI has dipped its toes, or should I say its whole body, into the world of video generation. Following in the footsteps of startups like RunwayML, the titular AI company announced Sora, a text-to-video AI model thatā€™s capable of producing some stunning ā€” almost concerning results.Ā 

It was announced yesterday, out of the blue, and it quickly took social media by storm. OpenAI CEO Sam Altman generated a number of videos based on peopleā€™s suggested prompts, including dogs recording a podcast, a drone race on Mars, and a variety of sea creatures riding bikes.Ā 

Sora works like the rest of OpenAIā€™s offerings ā€” enter a prompt as simple or as detailed as you like, and it will generate a minute-long 1080p video in whatever style you want, populated with things, people, animals, and different environments. You can also craft your blockbuster movie just by dropping in a still image which the AI will then go on to animate, or a video that can be extended by Sora.Ā 

According to OpenAI, Sora was trained on around 10,000 hours of ā€œhigh quality videoā€ and is built upon a transformer architecture, which apparently gives the model a superior scaling performance. It also uses the same ā€œrecaptioning technique from DALLĀ·E 3, which involves generating highly descriptive captions for the visual training data.ā€

Safety was a big concern for the team as well, so itā€™s not open to the public yet. Rather, the company is working with ā€œred-teamersā€ ā€” experts in things like misinformation, hate content, and bias ā€” who will be testing the model thoroughly before any release to the wider public.Ā 

Sora ā€” with all of its mind-blowing capabilities isnā€™t perfect though, and the team recognizes its weaknesses, particularly when it comes to physics, saying ā€œIt may struggle with accurately simulating the physics of a complex scene, and may not understand specific instances of cause and effect.ā€

As mentioned, Sora isnā€™t currently available to the wider public, and thereā€™s no release date yet. However, you can continue to reply to Sam Altman and maybe he will generate your prompt, or you can take a look at this curated gallery of examples made by a maker.

newsletter icon
The Leaderboard
Monday through Friday
Our ultra-fast Daily: Three takes on new products. Yesterdayā€™s top ten launches. Thatā€™s it.