Instant NGP from a Webcam(s)?

A user took a great deal and made it into a near live version of Instant NGP

A user took a great deal and made it into a near live version of Instant NGP

Michael Rubloff

Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

Instant NGP

Over the weekend, I saw a page title that caught my eye: Immediate NeRF from webcams. Slightly incredulous and curious to learn more, I clicked through it.

Github user Ednaordinary demonstrated in a discussion of the NV Labs Github page a running version of Instant NGP utilizing 12 webcams. The results are really decent actually considering only 12 inputs are powering it. Even moreso for a bunch of $4.99 webcams.

While her computer is utilizing a 3090, it on appears to be consuming 3.62GB of VRAM, making this attainable for more people.

But the real question is how far away are we from having full NeRF powered video conferences. The answer is not close at all, but this represents an exciting baseline. NeRF has its work cut out for it to compete with Apple’s recently announced Digital Persona and Google’s Project Starline and honestly there might not be much of a competition, but it’s encouraging to see someone using Instant NGP in a near live capacity.

For those looking to try this out for themselves, Ednaordinary warns the code is not a straight out of the box solution, but does write the changes she made to make it happen.

Please modify the following lines:

83: Inside the list add the numbers for the cameras you want (to get this do v4l2-ctl --list-devices, then if you have /dev/video1 and want to use it, put 1)84-89 and 101-104: These lines are to declare lists for multithreading. The simplest thing to do while still having a working script is to remove 84-89 and replace 101-104 withthreads.append(threading.Thread(target=camloop, args=[cams, 0])), though note this will be slower. If you would like to multithread, make lists for each set of cams and make new threads.append(threading.Thread(target=camloop, args=[cams, 0])) lines, replacing cams with each list and adding an offset number of the length of the previous list of cams (so that they do not overwrite eachother). At any time 1 camera will be accessed from each list. All cams are not accessed at once because of bandwidth issues.91: Add the directory for the scene and include "/images"Once the script is ready calling it with zero arguments will capture a picture from each webcam and write it, then do nothing. This is useful for capturing pictures just once and then using colmap2nerf.py. Once you have transforms.json, run it with "--scene ./data/nerf/webcam --gui --train --n_steps 100000000000" replacing ./data/nerf/webcam with the directory to the scene. n_steps is the number of steps to train, but we don't want to stop training, so set it really high.

I for one will probably be paying Walmart.com a visit and then shortly thereafter see how successfully I can get it to run.

Thumbnail for Gaussian Splatting News episode 13

13:12

Watch · New every Monday

The Biggest Week Yet for Gaussian Splatting: Blender + Unreal

Episode 13 · Nov 16, 2026

Blender 5.3 is out, and Gaussian splats are now a native part of it: PLY and SPZ files import as their own point cloud type and render in EEVEE, Cycles and Workbench, with no add-on.

Featured

Recents

Platforms

Daniel Skaale Releases SplatBox 1.3 for Unity

Daniel Skaale says SplatBox 1.3 for Unity adds new editing tools and paged LoD streaming for Quest 3, with Splat Box Editor at $99.50 until December 31.

Michael Rubloff

Nov 20, 2026

Platforms

Daniel Skaale Releases SplatBox 1.3 for Unity

Daniel Skaale says SplatBox 1.3 for Unity adds new editing tools and paged LoD streaming for Quest 3, with Splat Box Editor at $99.50 until December 31.

Michael Rubloff

Platforms

Splat Paint Turns Gaussian Splats Into Oil Paintings

Splat Paint by Tommy D. Rossi repaints Gaussian splats in the browser as oil paintings of 3D brush strokes, planned coarse to fine on a 40-color palette.

Michael Rubloff

Nov 20, 2026

Platforms

Splat Paint Turns Gaussian Splats Into Oil Paintings

Splat Paint by Tommy D. Rossi repaints Gaussian splats in the browser as oil paintings of 3D brush strokes, planned coarse to fine on a 40-color palette.

Michael Rubloff

Platforms

Splatara Cloud Renderer Streams Splats to Quest

Splatara Cloud Renderer streams PC-rendered Gaussian splats to up to four Meta Quest headsets over Wi-Fi, adding passthrough portals, colocation and occlusion.

Michael Rubloff

Nov 20, 2026

Platforms

Splatara Cloud Renderer Streams Splats to Quest

Splatara Cloud Renderer streams PC-rendered Gaussian splats to up to four Meta Quest headsets over Wi-Fi, adding passthrough portals, colocation and occlusion.

Michael Rubloff

Platforms

Vintage Click Puts a 1970s SLR Inside Gaussian Splats

Vintage Click 0.6.1 rebuilds lying snow as volume in a 1970s SLR photography game for Gaussian splat scans, with lens optics made inside the splat renderer.

Michael Rubloff

Nov 20, 2026

Platforms

Vintage Click Puts a 1970s SLR Inside Gaussian Splats

Vintage Click 0.6.1 rebuilds lying snow as volume in a 1970s SLR photography game for Gaussian splat scans, with lens optics made inside the splat renderer.

Michael Rubloff

Trending Articles
  1. TRENDING
    Loading...
  2. TRENDING
    Loading...
  3. TRENDING
    Loading...
Michael Rubloff

Written by Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

More from Michael Rubloff

More from Michael Rubloff

Platforms

Daniel Skaale Releases SplatBox 1.3 for Unity

Daniel Skaale says SplatBox 1.3 for Unity adds new editing tools and paged LoD streaming for Quest 3, with Splat Box Editor at $99.50 until December 31.

Michael Rubloff

Nov 20, 2026

SplatBox 1.3

Platforms

Daniel Skaale Releases SplatBox 1.3 for Unity

Michael Rubloff

Nov 20, 2026

SplatBox 1.3

Platforms

Daniel Skaale Releases SplatBox 1.3 for Unity

Daniel Skaale says SplatBox 1.3 for Unity adds new editing tools and paged LoD streaming for Quest 3, with Splat Box Editor at $99.50 until December 31.

Michael Rubloff

Nov 20, 2026

SplatBox 1.3

Platforms

Splat Paint Turns Gaussian Splats Into Oil Paintings

Splat Paint by Tommy D. Rossi repaints Gaussian splats in the browser as oil paintings of 3D brush strokes, planned coarse to fine on a 40-color palette.

Michael Rubloff

Nov 20, 2026

Splat paint

Platforms

Splat Paint Turns Gaussian Splats Into Oil Paintings

Michael Rubloff

Nov 20, 2026

Splat paint

Platforms

Splat Paint Turns Gaussian Splats Into Oil Paintings

Splat Paint by Tommy D. Rossi repaints Gaussian splats in the browser as oil paintings of 3D brush strokes, planned coarse to fine on a 40-color palette.

Michael Rubloff

Nov 20, 2026

Splat paint

Platforms

Splatara Cloud Renderer Streams Splats to Quest

Splatara Cloud Renderer streams PC-rendered Gaussian splats to up to four Meta Quest headsets over Wi-Fi, adding passthrough portals, colocation and occlusion.

Michael Rubloff

Nov 20, 2026

Splatara Cloud

Platforms

Splatara Cloud Renderer Streams Splats to Quest

Michael Rubloff

Nov 20, 2026

Splatara Cloud

Platforms

Splatara Cloud Renderer Streams Splats to Quest

Splatara Cloud Renderer streams PC-rendered Gaussian splats to up to four Meta Quest headsets over Wi-Fi, adding passthrough portals, colocation and occlusion.

Michael Rubloff

Nov 20, 2026

Splatara Cloud

New to Gaussian Splatting? Start here

Radiance fields, explained from the ground up: what a Gaussian splat is, how to capture one, and which tools and gear to start with.

Newsletter

Keep up with the field.

New research, tools and captures from the Radiance Fields newsroom, in your inbox. Free, no spam.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.