Field meet Explicit Geometric Representations (FEGR) enables Novel View Relighting and Virtual Object Insertion

NeRFs off the bat bake in the lighting and while creators such as Jonathan Stephens have explored relighting a scene through Instant-NGP, today there is another paper that not only allows for Novel View Relighting, but also extends to Virtual Object Insertion.

NeRFs off the bat bake in the lighting and while creators such as Jonathan Stephens have explored relighting a scene through Instant-NGP, today there is another paper that not only allows for Novel View Relighting, but also extends to Virtual Object Insertion.

Michael Rubloff

Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

FEGR

NeRFs off the bat bake in the lighting and while creators such as Jonathan Stephens have explored relighting a scene through Instant-NGP, today there is another paper that not only allows for Novel View Relighting, but also extends to Virtual Object Insertion.

NVIDIA, the University of Toronto, Vector Institute, and ETH Zurich present Fields meet Explicit Geometric Representations (FEGR). It reconstructs and decomposes scenes from captured images, enabling various applications like relighting and virtual object insertion.

FEGR combines the strengths of both NeRF and mesh-based methods to enable photorealistic relighting with specular and shadow effects.

Traditional methods face challenges in handling outdoor scenes or may have limitations in separating lighting and shadows from the scene. FEGR can effectively reconstruct scene geometry, materials, and lighting from a set of images, using a combination of neural fields and explicit mesh. This method enables photorealistic relighting and shadow effects on outdoor scenes and supports realistic virtual object insertion with accurate shadow casting. The technology is important because it can enhance the quality of various digital media and augmented reality applications, making them more immersive and visually appealing.

For those that are wondering how FEGR is pronounced, their paper states "feature".

FEGR also extends to use cases for VR and AR to create either more immersive experiences through lighting or climate changes as well as inserting 3D objects. For those looking to bring FEGR into other platforms, it is able to be exported into most modern pipelines and is exportable into gltf and USD.

FEGR, improves the realism of virtual objects placed into NeRFs. FEGR can accurately represent the location of light sources, like the sun, creating more realistic shadows and reflections on the inserted objects. A user study showed that the majority of participants found FEGR's results more realistic than other methods, highlighting its superior lighting estimation. This technology is important because it can enhance the quality of virtual object insertion in augmented reality applications and other digital media, making them more immersive and convincing.

While the virtual object insertion has almost infinite use cases, it is immediately obvious how much it impacts the autonomous driving industry. By allowing for a variety of scenarios and conditions, the simulations become all the more accurate and hopefully safer for humans.

However, the method does have limitations, such as being limited to static scenes and relying on manually designed priors. In the future, researchers hope to address these limitations by learning from more data and incorporating advances in dynamic neural fields.

We continue to see a trend of NeRFs focusing on large urban scenes, such as Grid-NeRF and Google Maps. All of these continue to show both researchers and corporations dedication to improving large scale immersive views.

I'm personally excited to see how large scale NeRFs impact the live ticketing and event industry.


Thumbnail for Gaussian Splatting News episode 13

13:12

Watch · New every Monday

The Biggest Week Yet for Gaussian Splatting: Blender + Unreal

Episode 13 · Nov 16, 2026

Blender 5.3 is out, and Gaussian splats are now a native part of it: PLY and SPZ files import as their own point cloud type and render in EEVEE, Cycles and Workbench, with no add-on.

Featured

Recents

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Platforms

ReactVision Advanced VPS Turns Phone Scans Into Splats

ReactVision Advanced VPS in ViroReact 3.1.0 turns a one-minute phone scan into a map, mesh, GLB model, object map and Gaussian splat in one coordinate frame.

Michael Rubloff

Nov 16, 2026

Platforms

ReactVision Advanced VPS Turns Phone Scans Into Splats

ReactVision Advanced VPS in ViroReact 3.1.0 turns a one-minute phone scan into a map, mesh, GLB model, object map and Gaussian splat in one coordinate frame.

Michael Rubloff

Trending Articles
  1. TRENDING
    Loading...
  2. TRENDING
    Loading...
  3. TRENDING
    Loading...
Michael Rubloff

Written by Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

More from Michael Rubloff

More from Michael Rubloff

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

CARLA

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

Michael Rubloff

Nov 17, 2026

CARLA

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

CARLA

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

New to Gaussian Splatting? Start here

Radiance fields, explained from the ground up: what a Gaussian splat is, how to capture one, and which tools and gear to start with.

Newsletter

Keep up with the field.

New research, tools and captures from the Radiance Fields newsroom, in your inbox. Free, no spam.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.