3D Security Alert - Be Aware of NeRF Attacks!

A guest post from Nicole Meng examines security in NeRF based reconstructions.

A guest post from Nicole Meng examines security in NeRF based reconstructions.

Nicole Meng

Nicole Meng

Nicole Meng is a PhD candidate in Electrical and Computer Engineering at Tufts University, where her research focuses on advancing the security and privacy of generative vision models. She holds a B.S. in Computer Science, Applied Math, and Economics from Brandeis University and an M.S. in Computer Science from the University of Connecticut. Prior to her graduate studies, Nicole worked as a full-stack software engineer at Pegasystems, where she contributed to their Workforce Intelligence software development and security enhancements.

IL2-NeRF

As NeRF models power everything from autonomous drones to VR platforms, tiny pixel tweaks can now send them off the rails. With the recent rapid advancements in 3D reconstruction models, specifically Neural Radiance Fields (NeRF), the field of generative computer vision has drastically progressed. Generalizable NeRF models, such as IBRNet and GNT, have further improved the reconstruction accuracy and the overall generalizability of NeRF models, making them a popular choice among industry deployment and real-life applications. Yet as these systems move into safety-critical domains, we must ask: Can we trust NeRF models when an attacker tampers with the input? 

Too often, the focus remains on visual fidelity sharper renders, smoother novel views, faster training and rendering time. But what happens when imperceptible changes in a single source image can cause a self-driving car’s perception to warp? Or a defense-simulation platform to misjudge an incoming threat? We ask a simple question: Can we trust these generalizable NeRF models? Specifically, can we trust their performance in the presence of adversarial attackers? Our answer, backed by rigorous research published in CVPR 2025 proceedings, is clear: Not in their current form. 

Introducing the IL2-NeRF Attack

We proposed the IL2-NeRF Attack: The first adversarial attack on Generalizable NeRF models under the L2 perturbation threat model.  Given the source view, we as attackers, could carefully craft a small adversarial perturbation bounded by a perturbation budget parameter ε. The budget ε is set to be small, making minimal visible changes on the source view. After that, the attacked source image gets passed through the GNeRF model and rendering pipeline, and the rendered images are collapsed into visible artifacts and distortions, as demonstrated in the figure below. 

Fig. 1. IL2-NeRF Attack Pipeline Demonstration

IL2-NeRF attack targets both the source image pixels and the scene ray representations of given images, iteratively adding small perceptible perturbations uniformly (L2 threat model) to the entire image with the optimization goal of maximizing rendering loss. The unique loss function in IL2-NeRF is custom-designed to be a weighted combination of 8 loss functions, primarily targeting the RGB and depth values of rendered views. 

This work exposes the security vulnerabilities of Generalizable NeRF models by demonstrating successful attacks on two popular NeRF models: IBRNet and GNT. Since IL2-NeRF lays the foundation for adversarial attacks under a new threat model, experimental results under a wide range of parameter settings were demonstrated across both synthetic and real-life object datasets. As demonstrated in the figure below, we can visibly see the visual artifact disruptions in the final rendered pictures across different objects under different perturbation budgets. These findings mark IL2-NeRF the first successful L2 adversarial attack on NeRF models. 

Why does this matter?

You might think a drop in visual quality is merely cosmetic. In reality, every rendered view can feed downstream tasks, like object classification in autonomous driving. A slightly distorted view can cause a car’s vision system to misidentify a pedestrian as a shadow. Or a stop sign as a billboard. With the right tailored optimization objectives, an attacker can twist those misclassifications at will, turning a minor artifact into a major safety hazard. 

Our work exposes a critical vulnerability in GNeRF models, producing glaring visual errors in the final 3D scenes from a tiny uniformed perturbation (well below perceptible thresholds). This kind of unpredictability is unacceptable in safety-critical domains such as defense simulations, where misrendered targets could compromise training fidelity and lead analysts to draw dangerously incorrect conclusions. 

In national security applications, where 3D reconstruction informs mission planning, infrastructure assessments, and threat identification, even minor distortions can cascade into flawed intelligence. 

By revealing how easily an attacker can hijack the rendering pipeline, IL₂-NeRF makes clear that security cannot be an afterthought. Robust defenses and adversarial testing must be integrated into NeRF workflows from day one, ensuring that tomorrow’s 3D vision systems remain both powerful and trustworthy. 

Thumbnail for Gaussian Splatting News episode 13

13:12

Watch · New every Monday

The Biggest Week Yet for Gaussian Splatting: Blender + Unreal

Episode 13 · Nov 16, 2026

Blender 5.3 is out, and Gaussian splats are now a native part of it: PLY and SPZ files import as their own point cloud type and render in EEVEE, Cycles and Workbench, with no add-on.

Featured

Recents

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Platforms

ReactVision Advanced VPS Turns Phone Scans Into Splats

ReactVision Advanced VPS in ViroReact 3.1.0 turns a one-minute phone scan into a map, mesh, GLB model, object map and Gaussian splat in one coordinate frame.

Michael Rubloff

Nov 16, 2026

Platforms

ReactVision Advanced VPS Turns Phone Scans Into Splats

ReactVision Advanced VPS in ViroReact 3.1.0 turns a one-minute phone scan into a map, mesh, GLB model, object map and Gaussian splat in one coordinate frame.

Michael Rubloff

Trending Articles
  1. TRENDING
    Loading...
  2. TRENDING
    Loading...
  3. TRENDING
    Loading...
Nicole Meng

Written by Nicole Meng

Nicole Meng is a PhD candidate in Electrical and Computer Engineering at Tufts University, where her research focuses on advancing the security and privacy of generative vision models. She holds a B.S. in Computer Science, Applied Math, and Economics from Brandeis University and an M.S. in Computer Science from the University of Connecticut. Prior to her graduate studies, Nicole worked as a full-stack software engineer at Pegasystems, where she contributed to their Workforce Intelligence software development and security enhancements.

New to Gaussian Splatting? Start here

Radiance fields, explained from the ground up: what a Gaussian splat is, how to capture one, and which tools and gear to start with.

Newsletter

Keep up with the field.

New research, tools and captures from the Radiance Fields newsroom, in your inbox. Free, no spam.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.