OpenAI may be the talk of the town when it comes to tech news today but thereās still more to cover.Ā
You might have missed:Ā
š” Google announced an AI cyber-defense initiative.Ā
š¤ Amazon claims its LLM is starting to show āemergent abilities.ā
š§ YC has put out a call for companies in AI, spatial computing, and more.
š Slack has added AI search and summarization to its feature-set.
š Lyft shares briefly surged 60% after a typo in its earnings report.
OpenAI has dipped its toes, or should I say its whole body, into the world of video generation. Following in the footsteps of startups like RunwayML, the titular AI company announced Sora, a text-to-video AI model thatās capable of producing some stunning ā almost concerning results.Ā
It was announced yesterday, out of the blue, and it quickly took social media by storm. OpenAI CEO Sam Altman generated a number of videos based on peopleās suggested prompts, including dogs recording a podcast, a drone race on Mars, and a variety of sea creatures riding bikes.Ā
Sora works like the rest of OpenAIās offerings ā enter a prompt as simple or as detailed as you like, and it will generate a minute-long 1080p video in whatever style you want, populated with things, people, animals, and different environments. You can also craft your blockbuster movie just by dropping in a still image which the AI will then go on to animate, or a video that can be extended by Sora.Ā
According to OpenAI, Sora was trained on around 10,000 hours of āhigh quality videoā and is built upon a transformer architecture, which apparently gives the model a superior scaling performance. It also uses the same ārecaptioning technique from DALLĀ·E 3, which involves generating highly descriptive captions for the visual training data.ā
Safety was a big concern for the team as well, so itās not open to the public yet. Rather, the company is working with āred-teamersā ā experts in things like misinformation, hate content, and bias ā who will be testing the model thoroughly before any release to the wider public.Ā
Sora ā with all of its mind-blowing capabilities isnāt perfect though, and the team recognizes its weaknesses, particularly when it comes to physics, saying āIt may struggle with accurately simulating the physics of a complex scene, and may not understand specific instances of cause and effect.ā
As mentioned, Sora isnāt currently available to the wider public, and thereās no release date yet. However, you can continue to reply to Sam Altman and maybe he will generate your prompt, or you can take a look at this curated gallery of examples made by a maker.