Stability AI's New Virtual Camera & Chief Pipeline Officer, Sony's OCELLUS Tracking, and More Hollywood Turmoil

In this episode of Denoised, hosts Addy Ghani and Joey Daoud cover significant developments in creative technology that impact filmmakers and media professionals. From Stability AI's new virtual camera tool and high-profile industry hire, to Sony's advanced tracking system, plus concerning signs in traditional Hollywood institutions, this episode provides essential insights for anyone working at the intersection of technology and filmmaking.

Stability AI Brings Oscar Winning VFX Legend Rob Legato On Board and New Virtual Camera Tool

Academy Award-winning VFX supervisor Rob Legato has joined Stability AI as their Chief Pipeline Architect, bringing decades of expertise from films like Avatar, Titanic, and The Lion King to the AI development space. Legato's appointment signals Stability's commitment to professional media production workflows as they continue developing tools for the filmmaking industry.

"I can't think of a better person," notes Addy. "He is an Oscar-winning, Tier 1 VFX supervisor who's super familiar with AI limitations and strengths of today."

This high-profile hiring coincides with Stability AI's release of Stable Virtual Camera, a new tool currently in research preview that transforms 2D images into navigable 3D environments. The system allows users to:

• Convert a single 2D image or up to 32 input images into a 3D space

• Program manual camera movements or use 14 preset camera paths

• Create camera movements like orbits, push-ins, and pull-outs

The implications for filmmaking could be substantial as the technology develops. Joey and Addy speculate that future iterations might integrate with physical camera tracking systems like Sony's OCELLUS or connect with smartphones for more intuitive control.

"I'd be really curious to see if Stability has any sort of internal short film that they're championing where Rob Legato comes in and significantly improves the quality bar, like producing a proof of concept kind of film," Addy comments.

Key takeaways about Stability AI's developments:

• Rob Legato brings professional VFX pipeline expertise to AI development

• Stable Virtual Camera creates 3D environments from 2D images

• The tool addresses cinematographers' need for camera control in AI-generated environments

• Future integration with physical camera trackers could create powerful hybrid workflows

Sony Enters the Camera Tracking Market with OCELLUS

Sony has introduced OCELLUS, a new high-level camera tracking system that works with any camera (though optimized for Sony's ecosystem). This tracking system uses depth sensors and SLAM (Simultaneous Localization And Mapping) technology to create real-time digital twins of environments.

The system includes:

• A sensor unit with cameras pointing in multiple directions

• A separate processing box that attaches to the camera back

• Three lens encoders (optional with compatible Sony lenses/cameras)

OCELLUS offers several advantages over competing systems:

• Works outdoors and in various lighting conditions

• Can operate with just one sensor if others are blocked or obscured

• Features an infrared mode for environments with strobing lights (like concerts)

• Includes built-in lens encoder support for focus, zoom, and iris data

"The nice thing about this system is it's ready to go to the Super Bowl," Addy explains. "Most systems are for indoor spaces, but because this is relying not just on visible data, but also depth data at different lighting conditions, you can take it outside."

The hosts note that OCELLUS enters a competitive market alongside systems from Zeiss CinCraft (formerly Ncam), Mo-Sys StarTracker, stYpe RedSpy, and others.

The OCELLUS launch completes more of Sony's end-to-end virtual production ecosystem, which already includes:

• Sony C LEDs (which the hosts note have exceptional color performance)

• Processing hardware for LED walls

• Venice 2 and Burano cinema cameras

"The only piece that I think is missing in the entire chain is a media server and software to run the stage," Addy observes.

Hollywood Industry Shifts: Panavision and Village Roadshow Face Challenges

The episode covers developments at two significant Hollywood companies:

Panavision Hollywood Closing

Panavision is closing its Hollywood location and consolidating operations at its Woodland Hills facility. While the company isn't disappearing entirely, this represents a significant downsizing for the iconic brand known for its high-end camera and lens rental business.

"I feel like it's a limited business model that makes it tougher in today's times," Joey notes, highlighting how Panavision's rental-only approach (they've never sold their cameras or lenses) puts them at a disadvantage compared to manufacturers like ARRI, RED, and Sony.

The hosts discuss whether Panavision might consider new business models:

• Potentially selling cameras rather than only renting

• Licensing their iconic brand name

• Potentially pivoting to AI or other emerging technologies

Village Roadshow Files for Chapter 11

Village Roadshow, the production company behind films like Joker and The Matrix (having co-produced over 100 films generating more than $19 billion in box office sales), has filed for Chapter 11 bankruptcy. While this doesn't necessarily mean the company is going out of business, it indicates significant financial restructuring.

The hosts connect these stories to broader industry trends:

• The "hollowing out of the middle" in film production budgets

• Streaming platforms taking over the mid-budget film space

• Shrinking theatrical windows making theatrical releases less viable

• The transition from "Hollywood 1.0" to new production models

"I feel really bad for Hollywood 1.0 companies like Technicolor, Panavision, Warner Brothers and all those companies that have been around for about a hundred years. They're kind of seeing the end of the road a little bit here," Addy reflects. "What I hope for is with the churn, you get a new generation of companies like Stability AI that can thrive in M&E, in Hollywood, in Los Angeles."

Other News: O Cinema Victory in Miami Beach

The episode opened with a positive update on O Cinema, a Miami Beach theater that had faced potential eviction and funding cuts after screening the documentary No Other Land. Joey reported that after significant community support and discussion about First Amendment rights, the mayor withdrew his proposal, allowing the theater to keep its location and funding.

"It's such a victory for media and entertainment because we don't see our civil liberties eroded away, our freedom of speech eroded away," Addy noted.

Conclusion: Industry in Transition

This episode of Denoised highlights the complex transition happening in the media and entertainment industry. While established Hollywood institutions face challenges, new technologies from companies like Stability AI and Sony are creating opportunities for different production approaches.

The hosts remain optimistic about the industry's future despite the current difficulties: "We've talked about this as a transition time and it's crappy when stuff like this happens, but still optimistic of what this shift is with the new tools and we can make bigger and better things with lower budgets with smaller teams," Joey concludes.

The views and opinions expressed in this podcast are the personal views of the hosts and do not necessarily reflect the views or positions of their respective employers or organizations. This show is independently produced by VP Land without the use of any outside company resources, confidential information, or affiliations.