Schemata comes out of stealth with 3D Scene Understanding Tech

AI start-up Schemata has come out of stealth to announce a simple but audacious goal: connect reasoning models to radiance fields.

AI start-up Schemata has come out of stealth to announce a simple but audacious goal: connect reasoning models to radiance fields.

Michael Rubloff

Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

Schemata

AI start up Schemata has come out of stealth to announce a simple but audacious goal: connect reasoning models to radiance fields. Their platform adds 3D scene understanding on top of high fidelity radiance field models, with the intention of creating virtual training and simulation applications for defense and enterprise customers.

When continuous radiance fields burst onto the graphics stage in 2020, we finally had photorealistic 3D representations of the world. What we did not have, as CEO James Brown now jokes, was anything smarter than “gorgeous static scenes.” After watching those early NeRF demos in graduate school at Stanford, Brown teamed up with AI researcher Huy Nguyen to build what they think is the next phase of radiance fields. “Photorealistic 3D reconstruction is step one,” they told me last week. “Step two is letting people work with 3D data as freely as they already work with text or video, by letting them query it, edit it, and build entire applications on top of it.”

Schemata’s pipeline remains proprietary while the team races toward full scale production, yet the outline is clear. Capture video, reconstruct a high-fidelity model from it, and run an internal 3D scene understanding model that creates a hierarchy of objects, parts, and affordances that downstream applications or analytics packages can tap into in real time. Something that we have tracked here at radiancefields.com for a while is that the broader research arc supports the bet.

In 2020, NeRF proved we could compress photoreal geometry into a single network, but left the scene devoid of semantics. By 2022, CLIP-infused systems such as OpenScene and Language Embedded Radiance Fields (LERF) began wiring language into point clouds and radiance fields, letting researchers ask for “every red thing” in a living room with zero additional labels. And just last year, Group Anything Radiance Fields (GARField) used Segment-Anything to lift multiscale object groups out of 3D space, paving the road to editable, object-centric worlds. The direction is obvious: tomorrow’s 3D engines will merge rendering, reasoning, and language into one differentiable world model.

Schemata believes it can be the first commercial bridge to that future. Early contracts within military training pipelines show that photorealistic trainers built in a few days can massively decrease the time and cost for effective virtual training and simulation applications that the DoD spends $14B on every year. Early commercial pilots support the thesis that highly regulated industries like Manufacturing and Oil and Gas want those same efficiency gains.

Nguyen is already looking past virtual training. “We see a world where spatially aware AI agents move through real space with the same contextual fluency that large language models now enjoy in the browser,” he says. “Virtual training is just the first stop.” If that vision lands, Schemata can supply the missing glue between photoreal rendering and high level reasoning.

Thumbnail for Gaussian Splatting News episode 13

13:12

Watch · New every Monday

The Biggest Week Yet for Gaussian Splatting: Blender + Unreal

Episode 13 · Nov 16, 2026

Blender 5.3 is out, and Gaussian splats are now a native part of it: PLY and SPZ files import as their own point cloud type and render in EEVEE, Cycles and Workbench, with no add-on.

Featured

Recents

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Platforms

ReactVision Advanced VPS Turns Phone Scans Into Splats

ReactVision Advanced VPS in ViroReact 3.1.0 turns a one-minute phone scan into a map, mesh, GLB model, object map and Gaussian splat in one coordinate frame.

Michael Rubloff

Nov 16, 2026

Platforms

ReactVision Advanced VPS Turns Phone Scans Into Splats

ReactVision Advanced VPS in ViroReact 3.1.0 turns a one-minute phone scan into a map, mesh, GLB model, object map and Gaussian splat in one coordinate frame.

Michael Rubloff

Trending Articles
  1. TRENDING
    Loading...
  2. TRENDING
    Loading...
  3. TRENDING
    Loading...
Michael Rubloff

Written by Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

More from Michael Rubloff

More from Michael Rubloff

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

CARLA

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

Michael Rubloff

Nov 17, 2026

CARLA

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

CARLA

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

New to Gaussian Splatting? Start here

Radiance fields, explained from the ground up: what a Gaussian splat is, how to capture one, and which tools and gear to start with.

Newsletter

Keep up with the field.

New research, tools and captures from the Radiance Fields newsroom, in your inbox. Free, no spam.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.