DIFIX3D+: Removing Artifacts and Floaters in Captures

NVIDIA has published a paper greatly helping detail recovery thanks to Generative AI.

NVIDIA has published a paper greatly helping detail recovery thanks to Generative AI.

Michael Rubloff

Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

Tags

difix3+

It shouldn’t surprise anyone here about my fascination with radiance fields and the power of reconstructing the world into lifelike 3D. However, sometimes when you capture, you might miss a section, or perhaps your camera shakes, or another unexpected thing happens.

While sometimes it’s unavoidable and sometimes it’s a user-induced error, these mistakes lead to artifacts and missing sections in your captures. A large volume of research has gone into solving this problem, and long-time readers of this site remember when we wrote about Nerflix in 2023. I’ve witnessed steady improvements, but DIFIX3D+ takes things up a notch.

DIFIX3D+ addresses these challenges by tapping into the rich priors of large-scale 2D generative diffusion models. Whereas many approaches query diffusion models during every training iteration (a process that can be slow and unwieldy), DIFIX3D+ adapts a single-step diffusion model, dubbed DIFIX, to correct artifacts in one efficient pass. This model is fine-tuned from an image diffusion framework (SD-Turbo), and it learns to “fix” the rendered novel views by conditioning on clean reference views.

Rather than waiting until the end of training to improve the overall 3D model, DIFIX3D+ employs a progressive update scheme. Cleaned views produced by DIFIX are distilled back into the 3D representation. In practice, the pipeline starts with an initial reconstruction and then iteratively perturbs camera poses, renders novel views, enhances them via DIFIX, and uses the improved images to update the 3D model. This iterative refinement ensures that even areas far from the original input views receive robust 3D cues, leading to a more consistent and faithful reconstruction.

Finally, at inference time, the same DIFIX model provides an additional real-time polishing step. After the 3D model produces its final novel view, DIFIX is applied once more to remove any lingering imperfections. Thanks to its single-step design, this post-processing adds only a minimal delay, making it practical for real-time applications.

DIFIX3D+ is a pipeline that leverages single-step diffusion models to both enhance and correct artifacts in radiance field representations. It further only requires a minimum of 8GB of VRAM, making it compatible with most commercial GPUs.

While it only specifically calls out its compatibility with NeRFs and Gaussian Splatting, I don’t see why this couldn’t be used with other radiance field representations, such as SVRaster and Radiant Foam.

Additionally, I believe this will make a large impact in the world of simulation for both generative workflows, using models like Cosmos, in addition to captures of the real world. The code is set to be released at some point in the future. We will keep you updated as it moves towards a release. More information can be found on their Project Page.

Thumbnail for Gaussian Splatting News episode 13

13:12

Watch · New every Monday

The Biggest Week Yet for Gaussian Splatting: Blender + Unreal

Episode 13 · Nov 16, 2026

Blender 5.3 is out, and Gaussian splats are now a native part of it: PLY and SPZ files import as their own point cloud type and render in EEVEE, Cycles and Workbench, with no add-on.

Featured

Recents

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

News

Volinga to Join Arquimea AI

Volinga is moving its Gaussian splatting capabilities into Arquimea AI and will stop selling Volinga Suite and Unreal plugin licenses on December 1, 2026.

Michael Rubloff

Nov 16, 2026

News

Volinga to Join Arquimea AI

Volinga is moving its Gaussian splatting capabilities into Arquimea AI and will stop selling Volinga Suite and Unreal plugin licenses on December 1, 2026.

Michael Rubloff

Platforms

Splat Repair Brings a Repair Brush to Gaussian Splats

Splat Repair 0.1.0 is an open-source Gaussian splat editor with a repair brush that rebuilds geometry, color and view-dependent appearance under painted areas.

Michael Rubloff

Nov 16, 2026

Platforms

Splat Repair Brings a Repair Brush to Gaussian Splats

Splat Repair 0.1.0 is an open-source Gaussian splat editor with a repair brush that rebuilds geometry, color and view-dependent appearance under painted areas.

Michael Rubloff

Michael Rubloff

Written by Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

More from Michael Rubloff

More from Michael Rubloff

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

CARLA

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

Michael Rubloff

Nov 17, 2026

CARLA

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

CARLA

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volinga to Join Arquimea AI

Volinga is moving its Gaussian splatting capabilities into Arquimea AI and will stop selling Volinga Suite and Unreal plugin licenses on December 1, 2026.

Michael Rubloff

Nov 16, 2026

News

Volinga to Join Arquimea AI

Michael Rubloff

Nov 16, 2026

News

Volinga to Join Arquimea AI

Volinga is moving its Gaussian splatting capabilities into Arquimea AI and will stop selling Volinga Suite and Unreal plugin licenses on December 1, 2026.

Michael Rubloff

Nov 16, 2026

New to Gaussian Splatting? Start here

Radiance fields, explained from the ground up: what a Gaussian splat is, how to capture one, and which tools and gear to start with.

Newsletter

Keep up with the field.

New research, tools and captures from the Radiance Fields newsroom, in your inbox. Free, no spam.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.