NEWSLETTER

All the new AI video tools Adobe announced

🌐 FastFill, SceneChange, ResUp and more

🌐 FastFill, SceneChange, ResUp and more

Author

Joey Daoud
October 14, 2023

Powered by

Welcome back to VP Land. Adobe just unboxed a can of AI stardust 💫

Project FastFill, SceneChange, ResUp, Stardust, and more.

Let’s jump into it!

MAIN STAGE

Adobe’s New AI Video Tools

Adobe just dropped a bunch of teasers on what’s to come with AI-powered tools inside the creative suite.

Check out their article for a full breakdown (of some things…we’ll actually cover stuff they didn’t below), but let’s go over all the video related ones below with demo videos (mostly from Adobe’s Senior Creative Evangelist, Kris Kashtanova).

Project FastFill
Generative AI fill for video

Which #AdobeMAX Sneak was your favorite? #ProjectFastFill is basically Generative Fill for video! 🤯

— Howard Pinsky (@Pinsky)
10:24 PM • Oct 13, 2023

Sketch to Image Generation

Something we are working at Adobe
Soon you will this level of control to make a sketch and direct your image generation!

#AdobeMax#CommunityxAdobe

— Kris Kashtanova (@icreatelife)
12:50 AM • Oct 12, 2023

Project SceneChange

#ProjectSceneChange

You’ll be able to put yourself in any scene including your artwork.

#AdobeMAX#CommunityxAdobe

— Kris Kashtanova (@icreatelife)
1:14 AM • Oct 12, 2023

Project Poseable

You will be able to pose your characters easily and then generate images with AI giving you more control.
Future of storytelling.

#ProjectPoseable

#AdobeMAX#CommunityxAdobe

— Kris Kashtanova (@icreatelife)
1:19 AM • Oct 12, 2023

Project ResUp
Video upscaling

This Sneak is so crispy. 💖 #ProjectResUp uses diffusion-based technology and artificial intelligence to convert videos from low-res to high-res. #AdobeMAX, what do you think... should this exploratory tech make it into product? adobe.ly/46qW0Pc

— Adobe (@Adobe)
1:27 AM • Oct 12, 2023

ProjectResUp is the tool I need like, tomorrow! wthhhh 🥹 wow, sneaks are mindblowing #AdobeMAX

— Julie W. Design (@juliewdesign_)
1:30 AM • Oct 12, 2023

Project Stardust

Object aware photo editing that turns objects in photos into moveable layers.

What if you could seamlessly move an object in flat photo with a single click? At #AdobeMAX we unveiled #ProjectStardust, an object-aware editing engine that accelerates and simplifies the editing process. adobe.ly/46qW0Pc

— Adobe (@Adobe)
5:41 PM • Oct 13, 2023

Firefly Image 2

New Firefly image mode with better outputs, trained on licensed or cleared images.

We released a new model 🎉

!!! Firefly Image 2 !!!!

As a scientist  I am in disbelief that such model is possible with a small dataset as we had.

We compensated artists for training it.  

We worked very hard on it. Please, enjoy!

#AdobeMax
Firefly.adobe.com

— Kris Kashtanova (@icreatelife)
4:09 PM • Oct 10, 2023

Analysis

A lot of these features are already available on other tools - video upscaling on Topaz, generative fill on Runway, and some scene tracking and animation with Move AI and WonderDynamics (sort of…Project SceneChange is a bit of a different use case).

But having them accessible inside the tools hundreds of thousands use every day is going to be a huge boost in adopting AI tools in everyday creative workflows.

SPONSOR MESSAGE

MASV is a faster, easier way to transfer large files to anyone, anywhere in the world—with just an internet connection.

Trusted by media and entertainment organizations across the globe, MASV plays an essential role in thousands of video workflows, giving production professionals absolute confidence in media delivery.

Unlike other file transfer services, MASV has no size limits and always delivers blazing-fast transfer speeds.

VIDEO VILLAGE

AKS

🌐 Around the Web

🎥 IMAX uses AI to "blow up" regular videos. IMAX CEO: “We use it to blow up images. We use AI to make the images look better, we sharpen the edges, and we take the grain out. We have been using AI for supplements for a while. And I think advances in the area will be very good”

🔲 Apple files a patent for displaying a virtual display in extended reality environments

👥 Hollywood actors endorse NO FAKES ACT, a bill barring unauthorized AI-generated replicas without consent

🌐 Schedule posts and track your social media with Metricool*

🗣 The HOLL·AI·WOOD AI Film and AI Games Festival roundup

🏟️ Meta debuts Quest 3 Depth API for dynamic occlusion in mixed reality

* Sponsored Link

CALL SHEET

📆 Upcoming Events

October 21 to 23
Gen:48 short film competition
Remote / Worldwide
Teams of filmmakers have 48 hours to ideate and execute a 1-4 minute short film

October 23 to 27 (other dates available)
Planar Studios Virtual Production Workshop
Planar Headquarters, Hillsboro, OR
Learn about VPXR technologies from industry experts

October 24 to 26
10th Edition Augmented Enterprise Summit
Houston, TX
World's biggest companies leveraging XR/Metaverse today and preparing for the future of work

Istituto Marangoni Visual Design Courses

Visual Design
Multimedia design for integrated communication
Milano - Sept 2023 to Jul 2024
London - Oct 2023 to Jun 2024

Digital Design for Immersive Experiences
Bridging physical and digital worlds and leveraging the power of immersive installations
Milano - Sep 2023 to Dec 2024

Have a film-related event to share? Just reply back to this email and let us know the details.

ABBY SINGER

Thanks for reading VP Land!

Have a link to share or a story idea? Send it here.

Interested in reaching media industry professionals? Advertise with us.

KEEP READING

NEWSLETTER

Netflix's 300 AI titles

PLUS: Thinking Machines opens Inkling, playable AI worlds you can steer