This music video put a bunch of new gear to the test

Powered by

Welcome to VP Land 🌐

We’ve got an interesting behind the scenes interview with Snehal Patel, who put a bunch of virtual production gear to the test (and documented his learnings) for his new music video.

We’ve also got some updates from Pixotope and Canon, plus some new AI research.

NAB is about a month away - if you’re interested in sponsoring our coverage in the newsletter and on YouTube, just hit reply.

Let’s jump into it!

STAGE A

Project Chimera

In the latest episode of the VP Land podcast, we dive deep into the making of Project Chimera with Snehal Patel, a music video project that blends classical Indian dance with high-tech filmmaking.

Snehal used the music video as an opportunity to test out new gear and production techniques, and he documented the process so others could learn.

Putting the Latest Tech to the Test

Here’s some of the gear & companies Snehal used in the production of Project Chimera:

Fujinon: Provided Premista Zoom lenses
Kino Flo Lighting Systems: Tested out MIMIK lights for lighting and expanding the 3D environment
RED Digital Cinema: Supplied RED KOMODO-X cameras
Fuse Technical Group: Provided a LED volume stage that had a curved backdrop for angled shots
Digital Nation Entertainment: Transformed actors into 3D models through volumetric scanning
stYpe: Provided camera tracking and lens calibration support
Spacewalk MoCo: Programmed the SISU C20 robot system for motion control shoots
MOD Tech Labs: Optimized Unreal Engine assets for visual effects
Tarform Motorcycles: Provided the Cyberbike Luna motor bike
Dengenuity Labs: Provided volumetric support

Plan the Shot, Work Backwards

One of Snehal’s takeaways was learning when virtual production makes sense - and when it doesn’t. And even if you are going the VP route, knowing what you need to achieve the shot will also help narrow down what you need (and what stage will work)…and avoid spending money on features you don’t need.

The key to figuring this out: getting very detailed in planning out your shots and the end result you want so you can work backward to figure out the best solution to achieve it.

Where AI helped…and where it didn’t

Snehal mostly used AI for pre-viz - building out mood boards and concept images for pitch decks.

He emphasized that this wasn’t a role he was replacing - he normally does this process himself, searching for images and compositing them into his vision in Photoshop.

But now instead of weeks, the process took just a few days.

For planning out the specific shots he worked with a storyboard artist - something he said was invaluable for quickly iterating ideas, planning out the entire video, and knowing what end result he needed so he could work backward (going back to the first note).

The limits he hit with AI: NeRF.

He wanted to scan one of the actresses to create a holographic character displayed on the virtual wall. Their first attempt was using 16 RED Komodo cameras. But NeRF playback wasn’t fast enough to make it practical.

They ended up scanning the actress at Digital Nation Entertainment.

Check out our full conversation for more insights and tactics Snehal used to create Project Chimera.

YouTube | Apple Podcast | Spotify | Overcast

SPONSOR MESSAGE

Learn Virtual Production with RIT at Synapse Studios, LA

As our industry pushes the boundaries of virtual production techniques (think Disney’s The Mandalorian and Marvel’s Avenger films), Rochester Institute of Technology (RIT) is opening the door for people like you to earn their spot on tomorrow’s set.

And they’ve started by tapping Hollywood's leader in VP, Synapse Virtual Production, as their partners for an exclusive learning experience.

This 10-day immersion will take place in Los Angeles, in June 2024 at Synapse Studios where students will work with the same technology and set as award-winning directors, cinematographers, producers, and more.

Co-taught by Professor David Long and other members of RIT’s MAGIC Center, a world-class digital media research and production facility, the course will provide the latest training in experiential elements for virtual production (VP).

In just two weeks, the course will train students in foundational skills of Virtual Production, which involves hands-on filmmaking, 3-D graphics, computational photography, and real-time engine rendering. An opportunity like this will jumpstart their careers and fill the demand for qualified talent across virtual production crews.

The first immersive course will take place this summer June 10-14 and June 17-21, 2024.

Space is limited, hurry to gain your spot on set before it’s gone!

To learn more about the course and to enroll, visit RIT’s course page here.

SECOND UNIT

Pixotope launched its own iPhone VP app - Pixotope Pocket.

Canon's C500 Mark II is getting a firmware update on March 21 that improves Cinema RAW recording options (the camera will now be able to record 12-bit RAW in all frame rates).

Morph Studio is a new platform using node-based editors to build out generative AI videos using Stability AI. Waitlist opened.

Vinten released free technology guides on AI and machine learning in modern studio production