- VP Land
- Posts
- The robots can now speak
The robots can now speak
š SwitchLight, LTX Studio, EMO, and more AI
Powered by
Welcome to VP Land š
(not to be confused with Wonka Land)
Today weāve gotā¦more AI updates!
From talking images to consistent characters to relighting live-action footage with machine learning, thereās still a lot that happened in AI this week.
Then weāve got a collection of behind-the-scenes videos for your weekend viewing.
And our roundup of other VP news, including this teaser from Bad Decisions Studio that theyāre going to release a 20-part Unreal Engine tutorial series for free on their YouTube channel.
Also, a handful of new VP events added to the event calendar.
Alright, letās jump into it!
STAGE A
Another week, another batch of crazy AI updates.
Lip Sync
Sora gave us some of the most realistic-looking text-to-video outputs.
Now weāre seeing lipsync. But itās not from OpenAI.
The first model is from Alibaba called EMO: Emote Portrait Alive.
Input audio plus a single image generates a talking image. But this is more than just lip-syncing - the head shifts poses and the face conveys expression through the eyes and eyebrows.
Just in š
this is the most amazing audio2video I have ever seen.
It is called EMO: Emote Portrait Alive— Stelfie the Time Traveller (@StelfieTT)
Feb 28, 2024
Then we also have Pika, in partnership with ElevenLabs, released early access to lip sync.
We know thereās been a lot of talk about AI generated video recently. Well, look whoās talking now!
Early Access to Lip Sync is available for Pro users now at .
— Pika (@pika_labs)
Feb 27, 2024
Adobeās AI Music Generator
Adobe Research previewed a new text-to-music generator that can create (or co-create as the video notes), modify, loop, and extend music.
Consistent Characters & ML Lighting
Two other new updatesā¦
Hoon Kim, founder of Beeble, posted a demo video of SwitchLight, which uses machine learning to analyze a scene and relight it.
Zeev Farbman, CEO of Lightricks, announced LTX Studio, a GenAI video platform with what they call ādirectorialā tools: camera control, consistent characters, scenes, and story structure.
SPONSOR MESSAGE
OpenReel offers a cutting-edge solution for creating and managing branded videos with ease.
It provides customizable templates, allowing you to record yourself or your screens, and integrates branded elements like logos and colors. The platformās user-friendly interface ensures that even if you have no video editing experience, you can produce professional-quality content.
This makes OpenReel ideal for various applications, including marketing, sales, customer service, and internal communications.
Ready to elevate your video content? Try OpenReel today for free and discover how simple and effective video creation can be. With its intuitive design and powerful features, youāll be able to create stunning videos that resonate with your audience.
Start your journey with OpenReel now and transform your video production experience.
VIDEO VILLAGE
When youāre done watching Dune 2 this weekend, hereās a collection of some BTS videos for your weekend playlist.
AKS
š Around the Web
š The USC School of Cinematic Arts debuts its first ever senior thesis course for virtual productionĀ
š¬ Disguise heads to SXSWĀ
š Schedule posts and track your social media with Metricool*
š§ CG Pro Inner Circle opens up membership to the publicĀ
šØāš¼ Magicbox welcomes Alon Hammer as new CTO
š§ Bad Decisions Studio will release a comprehensive Unreal Engine 5 tutorial series for beginners for free on their YouTube channel
* Sponsored Link
CASTING CALL
VP Gigs
Inside Sales Representative
Magicbox
Virtual Production Stage Technician, StageCraft
Industrial Light & Magic
Virtual Production Manager, CBS News
Paramount/CBS
Senior Concept Artist
ILM London
Producer/Project Manager
Cuebric
Unreal FX Artists
WildBrain Studios
CALL SHEET
š Upcoming Events
February 11-April 22
Color Management for Virtual Production - On Set (Ireland)Ā
February 28-March 1
Mo-Sys Academy:Ā 3-Day Camera Technicianās Course
March 11-15
Mo-Sys Academy:Ā 5-Day ICVFX Course
šĀ March 12-April 24
Color Management for Virtual Production - Live/Online (London)
šĀ March 16
CINELEASE Open House
šĀ March 21
NY Video Winter Meetup (ft. Mobile Journalism)
šĀ April 13
Virtually Everything! Summit
šĀ April 24-April 25
Color Management for Virtual Production - On Set (London)
View the full event calendar and submit your own events here.
ABBY SINGER
Thanks for reading VP Land!
Have a link to share or a story idea? Send it here.
Interested in reaching media industry professionals? Advertise with us.
Join the conversation