Sora's "internal beta" opens ahead of schedule, and unemployment in film and television is coming

Just yesterday, Sora had another new "masterpiece" released!

Two Sora authors, Bill Peebles and Tim Brooks, have released new pictures. (By the way, you also showed off your gay friendship?)

"A red panda and a toucan are best friends, walking in the blue hour "In Santorini," Peebles said the scene was exactly the same as the scene when the two walked to the OpenAI office.

a red panda and a toucan are best friends taking a stroll through santorini during the blue hour

The coherence of this video is simply amazing Phew: The red panda and toucan look consistent throughout every frame.

Of course there are still many flaws if you look carefully. For example, the red panda's legs sometimes intertwine, making the image look more like a cartoon image than a realistic real-world image.

But in general, this kind of video quality is enough for us to let our imagination run wild about the future of AI video.

Some netizens immediately made a dubbing version. Once the appropriate dubbing came out, the video had more flavor!

No wonder Hollywood director Tyler Perry bluntly said that after watching the video produced by Sora, he directly shelved the US$800 million expansion plan of his cinematographer studio!

More "masterpieces" are coming

This time the two authors released the third The second batch of videos has more realistic and explosive effects.

Netizens continue to marvel: How does Sora get better with each iteration?

This video is "A diver discovers a hidden future sunken ship containing cybernetic sea creatures and advanced alien technology."

a scuba diver discovers a hidden futuristic shipwreck, with cybernetic marine life and advanced alien technology

Divers, underwater landscapes, sunken ship shells, and the alien technology inside are all generated very realistically.

Of course, this scene is not 100% perfect. Someone immediately discovered flaws - for example, the diver could swim without swinging his fins, nor did he spit out bubbles.

A Hollywood film producer complained: People's movements look soulless, a bit like zombies.

But for less discerning viewers, the quality of this 20-second video is more than enough.

Someone said with satisfaction: It looks like a high-resolution version of "Deep Sea Trek"

In the past, this scene would undoubtedly cost a lot of money. Now, all the difficult and gold-burning scenes in Hollywood blockbusters can be replaced by Sora videos. It is not just a lie that AI will eliminate the film and television industry!

This little white dragon with shimmering silver scales, icy blue eyes and ivory horns, and exhaling white breath, also made netizens exclaim. , my wife was shocked!

Close-up of a majestic white dragon with pearlescent, silver-edged scales, icy blue eyes, elegant ivory horns, and misty breath. Focus on detailed facial features and textured scales, set against a softly blurred background

Its personification is well done, with watery eyes, conveying a very moving emotion , as if he could understand human speech.

The dragon in "Game of Thrones" is like this. Compared with it, the gap between Xiaobailong and Xiaobailong is not that big.

Some netizens said that they couldn't put it down for this little white dragon and directly dubbed it——

So a dubbing contest began .

Real-life scenarios are the most difficult test questions for Sora.

In the following video of "a man BASE jumping over the tropical waters of Hawaii, with his pet macaw flying beside him", Sora once again delivered an impressive performance Answer sheet.

a man BASE jumping over tropical hawaii waters. His pet macaw flies alongside him

The scene is so lifelike that some people directly asked: "Is it a real video or made by AI?"

After dubbing it, it looks like this. How many people will find out that this is not a real scene?

If I have to find fault, it is that the lighting of the macaw is not quite right. It looks like a separate animation, not like the lighting under natural conditions.

BASE jumping movements are not generated accurately enough and the parachute is too small.

Below is a glass turtle, its cracks repaired with goldsmithing, walking on a black sand beach at sunset.

The consistency of the picture is perfect, and the physical properties of the sand are fully restored.

But the only drawback is: the turtle seems to have only three legs? ?

Some people also discovered "Hua Dian": Is it to make the sand dunes rugged so that the turtles will not leave traces after climbing over the sand dunes?

In contrast, the glass turtle generated by Midjourney looks like this, which has a different flavor.

A ship in the exquisite paper art world, with marine animals jumping out of the sea.

in a beautifully rendered papercraft world, a steamboat travels across a vast ocean with wispy clouds in the sky. vast grassy hills lie in the distant background, and some sealife is visible near the papercraft ocean's surface

The dark neon rainforest shines with fantastic flora and fauna.

a dark neon rainforest aglow with fantastical fauna and animals

But for this Some people criticized the video and said: "This is the worst demo of Sora I have ever seen. It generates a vector animation style for some reason."

One A cat who only wears glasses and appeared in spy movies of the 1960s.

cat in glasses in a 1960s spy movie

At dusk, a Huge translucent jellyfish float gracefully in a deserted city, a surreal scene shot on 35mm film.

A surreal scene unfolds as a giant, translucent jellyfish floats gracefully through a deserted cityscape at dusk. The scene is shot on 35mm film

This is an elaborate diorama: a lone samurai walks slowly through the town in front of a wooden building during the Edo period.

A meticulously crafted diorama depicting a serene scene from Edo-period Japan. Traditional wooden architecture. A lone samurai, clad in intricate armor, walks slowly through the town

A little fat pug wearing goggles sits on a stool next to an old motorcycle.

If you look closely, you can see that the way the dog's belly breathes in and out looks very real.

a small chubby Pug dog in goggles is sitting on a stool next to an old motorcycle

A brown border collie wears sunglasses and skates on a skateboard.

a brown and white border collie stands on a skateboard, wearing sunglasses

The terrible thing happened. Someone left a message below saying that the brown border collie was his dog and that he took this video.

And we were in a daze for a moment: Is what he said true or false?

In short, netizens can’t wait for the public beta.

Someone also gave Sora a magic test question - "A mobile phone is live broadcasting the process of entering a black hole."

Netizens speculate: Unreal Engine was used to generate part of the data set?

As these videos were released, netizens’ questions became more and more intense——

What data is the Sora model trained on?

Many netizens also feel that the pictures generated by Sora look a bit familiar? It's as if it was made directly with Unreal Engine.

Subsequently, more and more people recognized that the data set trained by Sora should have been generated using UE.

In fact, when Sora was first born, everyone predicted that Sora would be powered by a game engine.

Pytorch co-founder Soumith Chintala thinks so.

Data scientist and machine learning engineer Ralph Brooks also gave his own analysis:

If you want to create a large number of high-definition videos with different angles, you need to simulate. Among them, there are many clues that lead me to believe that UE5 is used to create training data to a certain extent.

For example, in this well-known cherry blossom walk video, the way the characters move is very similar to that in UE5. People in real life do not walk at a constant speed.

NVIDIA senior scientist Jim Fan also said, "I wouldn't be surprised if Sora was trained on a large amount of UE5 synthetic data!"

Of course, it may not explicitly call UE5, but it is very likely that UE5 will be generated Text and video pairs are added to the training set as synthetic data.

It has long been predicted that Sora's inference pipeline uses a CLIP base, text-to-3D object conversion, and game engine simulation.

Sure enough, "exhaustion of artificial training data" will not stop the development of LLM. Synthetic data is the future of AI!

The "lite version" experience is hidden in the technical report!

Netizens are already itching to see these demos that are getting better and better from generation to generation.

The good news is: Although Sora has not officially opened the function, it can already be experienced in the technical report!

Report address: https://openai.com/research/video-generation-models-as-world-simulators

By selecting different keywords , such as characters, clothing, weather environment, geographical location and other options, you can experience different videos generated by Sora.

In this way we can see - a is wearing clothes like b, taking a pleasant walk in the weather d at location c.

Hollywood bosses are frightened. Is the film and television industry really over?

It’s no wonder that Tyler Perry, a well-known Hollywood director, producer, and actor, decided to shelve his $800 million expansion plan for his Atlanta studio because of Sora.

Originally, Director Perry had planned to spend US$800 million to expand his studio over the past four years, adding 12 studios to the 330-acre land.

However, after watching the video made by Sora on February 16, he decided to cancel his $800 million plan because in the blockbuster film he shot, You may not need to find a location or build a real scene.

"Before, we were only told that AI could do these things, but seeing it actually do it was still so shocking!"< /p>

Director Perry said that because Sora had such a strong impact on him, the US$800 million expansion plan has been postponed indefinitely.

Now, when making a movie, you no longer need to physically travel to the filming location.

Whether you want a Colorado snow scene, a scene on the moon, or a scene of two people in a living room in the mountains, never build a real set again. You can do it all from your office computer!

And this means that huge changes will affect every corner of the industry, affecting all practitioners such as actors, lighting, transportation, sound effects and editing. rice bowl.

Now, Director Perry has used AI in both on-set shooting and post-production in two movies, avoiding the need to spend hours applying old age makeup on actors.

The emergence of Sora completely changed the rules of the game.

In the past, HBO's pilots might cost 15 million, 20 million or even 35 million US dollars, but now, this cost is unimaginably low. The company will obviously choose the cheaper option.

In the near future, many jobs will disappear.

What kind of safety protection measures should the film and television industry establish to save everyone's jobs?

Reference materials:

https://www.hollywoodreporter.com/business/business -news/tyler-perry-ai-alarm-1235833276/

https://twitter.com/JMT3/status/1761443473218240558

https://twitter.com/_tim_brooks/status/1761236971186438178

https://twitter.com/model_mechanic/ status/1761198301482021084