VIRTUAL PRODUCTION

Prime 360 Is Prime Video's New Virtual Camera System for 3D-Reconstructed NBA Replays

Prime 360 Is Prime Video's New Virtual Camera System for 3D-Reconstructed NBA Replays

Prime Video introduced Prime 360, an AI-powered virtual camera system that reconstructs recorded basketball action as a 3D scene and shows replays from angles its physical broadcast cameras can't capture. Virtual viewpoints are rendered after capture from footage the courtside camera array has already recorded.

  • Every replay starts with recorded footage. According to Prime Video's Woody Arrington, calibrated, synchronized cameras surround the court, and the capture moves to the AWS cloud for 3D reconstruction.
  • Prime Video compares it to a video-game camera. Associate producer Josh Green told SVG that "there are no plays that are off-limits" and to "think of it like a video-game camera."
  • AWS Trainium chips power the system. Sports on Prime credits AWS Trainium chips, and SVG reports the system was developed jointly by Prime Video producers, engineers, and AI scientists.
  • It debuts with Prime Video's second NBA season. Prime 360 highlights appear on select broadcasts within a slate of more than 100 games.
  • Key specs are missing from the announcement. Prime Video's announcement does not give a camera count, reconstruction accuracy figures, or processing times.

Synchronized perimeter cameras feed a 3D scene rebuilt in the AWS cloud

According to Sports Video Group, Prime 360 relies on an array of high-resolution cameras positioned around the court. Woody Arrington, principal product leader for Prime 360 at Prime Video, laid out the pipeline.

"There are cameras placed in a full perimeter around the court. Each one of those cameras is calibrated and synchronized with each other and capturing that action from all angles. We then transport that into the AWS cloud, where we can then reconstruct that 3D scene."

SVG reports that the footage is "instantly processed through proprietary AI-powered models to generate immersive and cinematic highlights."

Wade Wakashige, director and head of live sports product management at Prime Video, said the system grew from small tests. "We started very simply and bootstrapped with very rudimentary cameras to determine if it was even possible and slowly grew out from there," he told SVG, adding that "it really takes a collaborative effort across production, science, software, and infrastructure."

Prime 360 renders new viewpoints of recorded game action

A Prime 360 replay is built from a real possession recorded by the camera array. When a replay shows an angle where no physical camera stood, that view comes from the 3D scene Prime Video reconstructs from the synchronized footage.

Each replay depicts a possession that took place on the court, with synchronized camera footage as the system's input. The Sports Video Group report describes Prime 360 as "a photorealistic virtual camera system built for live broadcast" that lets fans see action from angles traditional broadcast cameras wouldn't capture.

Green framed the range of the system in terms of coverage. "The beauty of this technology is that there are no plays that are off-limits," he told SVG, calling it "a replay machine that truly is one of a kind."

Prime 360 leads the technology additions for an expanded NBA on Prime slate

Prime Video will produce more than 100 regular-season and postseason games in its second NBA season, according to SVG, including its first exclusive Eastern Conference Finals.

SVG names Prime 360 as the headline technology addition for the season. Prime 360 highlights appear on select broadcasts within that slate, so viewers should not expect reconstructed replays on every game.

KEEP READING