PRODUCTION & POST

Netflix Explores Gaussian Splats as a Streaming Format While Blender and Unreal Engine Add Native Support

A living-room TV with a Netflix logo shows a palace ballroom that breaks apart into colorful translucent ovals drifting toward a sofa.

Netflix is investigating Gaussian splats as a future streaming format for TVs, streaming sticks, phones and laptops, according to Lowpass's reporting on a Netflix job listing. On the production side, native splat support has landed in two key 3D tools, which Lowpass says could lead to further adoption.

  • The streaming effort is an internship project. Netflix is hiring a 24-week paid Video Algorithms intern to study whether splats can work as a streaming format.
  • Compression and encoding time are among the open challenges. Netflix names faster training/encoding and more efficient compression as hurdles before splats can reach consumer devices.
  • Eyeline is further along on production. Netflix's Eyeline VFX studio has published research on capturing film performances as 4D splats.
  • Blender 5.3 treats splats as native objects. The Blender 5.3 release imports, edits and renders splats in all of its built-in renderers.

Netflix's streaming test starts with compression and encoding time

Netflix's Video Algorithms intern listing describes Gaussian splatting as a 3D/4D reconstruction technique with photorealistic novel-view synthesis and low rendering complexity. Netflix says that low complexity is what makes splats attractive for consumer devices.

The intern's job, with "a focus on building towards a practical system," is to measure how far splats are from being streamable:

  • Compression. Test splat model compression strategies on open datasets.
  • Trade-offs. Characterize how model size, training time and rendered quality trade off, and quantify the gap to streaming-rate targets.
  • Speed. Experiment with cutting training/encoding time or improving compression efficiency.
  • Proof-of-concept. Design and build a demo that showcases splat-based rendering on "content of interest."

Lowpass's Janko Roettgers reads the intern staffing as a sign this isn't at the top of Netflix's priority list. He also hints that consumers could be exploring 4D splats on their own devices within months.

His hypotheticals show what that could look like: a Netflix app that lets Bridgerton fans explore Queen Charlotte's palace in 3D, or episodes viewers watch from a vantage point they pick as the action unfolds.

Eyeline already captures multi-actor performances as 4D splats

Netflix's Eyeline studio has been working on improving splat quality for volumetric film capture, per Lowpass.

Its DEGS research, presented at SIGGRAPH Asia, describes multi-performer 4D capture that produces free-viewpoint video up to and including 4K facial closeups. The pipeline splits the job across two rigs and a diffusion model:

  • Scene Rig. Captures full-body, multi-actor performances at a resolution below 4K production quality, reconstructed with a 4D Gaussian splatting framework called Poly4DGS.
  • Face Rig. Records high-fidelity facial detail from the same actors, one at a time, as reference.
  • Detail enhancement. A Flux-based diffusion model, fine-tuned on that Face Rig data, learns to push low-quality splat renders (50K-200K Gaussians) toward high-quality ones (4M Gaussians) for closeups.

The authors, including Paul Debevec, say they designed the pipeline for the demands of high-end media production.

Lowpass reports that splats have shown up in a growing number of movie, TV and music-video productions. Its full report looks at how Netflix and others in Hollywood, including Industrial Light & Magic, are using them.

An armored figure in a silver helmet stands beside a gray and yellow striped spaceship with an open ramp on a rocky desert plain
An armored figure beside a striped spaceship on a rocky desert plain, from Lowpass's report on Hollywood's use of splats. Image: Lowpass

Blender 5.3 and Unreal Engine make splats a native asset

Lowpass reports native splat support arrived in both Blender and Unreal Engine, two key 3D production tools.

For Fortnite creators, Epic's UEFN splat documentation covers bringing photoreal splat scenes and objects into islands.

Third-party plugins have targeted the engine too, including Volinga Plugin Pro 0.8.0, which added watermark-free deployment and performance modes for splats.

Blender 5.3 shipped native Gaussian splats alongside DLSS denoising and ripple video editing.

Blender's developer blog post calls it initial support and lays out how it works:

  • Drag-and-drop import. Splats come in as .PLY or .SPZ files, or load from USD.
  • Point cloud under the hood. A new Pointcloud Type geometry node exposes splats, which carry position, 3D scaling, quaternion rotation and radiance stored as spherical harmonics.
  • Editable shading. Splats default to an emissive material you can change in the shader editor, though Blender says relighting is at an early stage.
  • Renderer quirks. EEVEE uses dithered transparency that's noisy, so raise the sample count; Workbench needs flat lighting to look right; Cycles intersects each ray with a splat at its point of maximum opacity.

Blender says it will keep refining the implementation in upcoming releases.

KEEP READING