The robots can now speak

Powered by

Welcome to VP Land 🌐

(not to be confused with Wonka Land)

Today we’ve got…more AI updates!

From talking images to consistent characters to relighting live-action footage with machine learning, there’s still a lot that happened in AI this week.

Then we’ve got a collection of behind-the-scenes videos for your weekend viewing.

And our roundup of other VP news, including this teaser from Bad Decisions Studio that they’re going to release a 20-part Unreal Engine tutorial series for free on their YouTube channel.

Also, a handful of new VP events added to the event calendar.

Alright, let’s jump into it!

STAGE A

Another week, another batch of crazy AI updates.

Lip Sync

Sora gave us some of the most realistic-looking text-to-video outputs.

Now we’re seeing lipsync. But it’s not from OpenAI.

The first model is from Alibaba called EMO: Emote Portrait Alive.

Input audio plus a single image generates a talking image. But this is more than just lip-syncing - the head shifts poses and the face conveys expression through the eyes and eyebrows.

Just in 👀

this is the most amazing audio2video I have ever seen.
It is called EMO: Emote Portrait Alive
— #Stelfie the Time Traveller (#@StelfieTT)
7:39 AM • Feb 28, 2024

Then we also have Pika, in partnership with ElevenLabs, released early access to lip sync.

We know there’s been a lot of talk about AI generated video recently. Well, look who’s talking now!

Early Access to Lip Sync is available for Pro users now at pika.art.
— #Pika (#@pika_labs)
3:57 PM • Feb 27, 2024

Adobe’s AI Music Generator

Adobe Research previewed a new text-to-music generator that can create (or co-create as the video notes), modify, loop, and extend music.

Consistent Characters & ML Lighting

Two other new updates…

Hoon Kim, founder of Beeble, posted a demo video of SwitchLight, which uses machine learning to analyze a scene and relight it.

Zeev Farbman, CEO of Lightricks, announced LTX Studio, a GenAI video platform with what they call ‘directorial’ tools: camera control, consistent characters, scenes, and story structure.

SPONSOR MESSAGE

OpenReel offers a cutting-edge solution for creating and managing branded videos with ease.

It provides customizable templates, allowing you to record yourself or your screens, and integrates branded elements like logos and colors. The platform’s user-friendly interface ensures that even if you have no video editing experience, you can produce professional-quality content.

This makes OpenReel ideal for various applications, including marketing, sales, customer service, and internal communications.

Ready to elevate your video content? Try OpenReel today for free and discover how simple and effective video creation can be. With its intuitive design and powerful features, you’ll be able to create stunning videos that resonate with your audience.

Start your journey with OpenReel now and transform your video production experience.

Learn more and start your free trial.