Back in February, Nuke 17.0 formally added gaussian splatting support into their main product. Yesterday, Foundry released Nuke Stage, a new application purpose built for virtual production workflows. Specifically, it targets In-Camera Visual Effects, the practice of filming against massive LED walls displaying real time environments, so that the background is captured directly in camera rather than composited in later.
ICVFX demands real-time, photorealistic rendering at the very moment of photography. The LED wall needs to display the environment as it would actually look from the camera’s perspective, including proper parallax, lighting interaction, and color accuracy. Rasterized game engine environments have been the standard, but they carry obvious limitations around capture based realism. Gaussian Splats, reconstructed from real world footage, offer scenes that look like the real places they were scanned from, rendered at interactive frame rates.
This creates a compelling use case that’s distinct from anything in the compositing pipeline. When Nuke 17.0 added splat support to the Node Graph, the value was in review, grading, and integration with keyed elements. Nuke Stage’s splat rendering happens upstream, on set, in the camera, before any plate exists. The director sees the Gaussian Splat environment in the viewfinder. The lighting on the actors reflects the LED wall’s splat rendered illumination. The shot is captured, not composited.
Foundry’s decision to build this as a separate application rather than a Nuke panel or plugin reflects how different virtual production demands are from post-production workflows. Nuke Stage presumably connects back into the broader Nuke ecosystem for color management and pipeline integration, but its real-time rendering priorities, stage geometry management, and LED display calibration requirements are distinct enough to warrant their own product surface.
Foundry entering this space with Gaussian Splat rendering as a headline feature is a meaningful signal about where the industry sees real time photorealistic backgrounds heading. Radiance field based environments, rendered in real time on the stage floor, represent a different philosophy from procedurally built game engine sets and Nuke Stage is now a production tool that embodies that philosophy.
New to Gaussian Splatting? Start here
