NVIDIA Publishes Blog on Marble Workflow for Robotics Simulation with Isaac Sim

NVIDIA just published a tutorial on how to bring World Labs into simulation.

NVIDIA just published a tutorial on how to bring World Labs into simulation.

Michael Rubloff

Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

World Labs NVIDIA

NVIDIA has published a new end-to-end tutorial demonstrating how World Labs’ Marble can be integrated directly into Isaac Sim, positioning generative world models as a practical tool for robotics simulation rather than a speculative one.

As a quick refresher, Marble is the first publicly available model from World Labs. Using either a reference image or a text prompt, users can rapidly generate an explorable 3D scene rendered using Gaussian splatting, with the ability to export those worlds for downstream workflows.

The NVIDIA article walks through a complete pipeline that takes a Marble generated environment, exported as Gaussian splats alongside a collider mesh, and brings it into Isaac Sim using NVIDIA Omniverse NuRec and USD.

The workflow itself is notably straightforward, and it illustrates well why the industry has become increasingly excited about gaussian splatting for simulation based pipelines. In NVIDIA’s approach, environments are sourced from the public Marble gallery, where worlds can be generated from text prompts, images, video, or coarse 3D structure.

Each scene is exported in two complementary forms. The standard .ply file containing the Gaussian splats for visual fidelity, and a GLB collider mesh that provides the geometry required for physics and collision handling. Downloading custom scenes requires a paid World Labs subscription, though sample assets are available. Alternatively, you can also use something like NVIDIA’s Lyra or Hunyuan’s World 1.0.

To bring the splats into Isaac Sim, NVIDIA leverages Omniverse NuRec, which the company first introduced at SIGGRAPH earlier this year. The Marble generated .ply file is converted into USDZ using a conversion script from NVIDIA’s 3DGRUT library. In this process, the Gaussian splats are represented as a volumetric USD primitive, allowing Omniverse to render them efficiently while keeping them fully embedded in the USD scene graph.

Once imported into Isaac Sim, the radiance field is aligned and scaled to real world dimensions. NVIDIA’s tutorial walks through grounding the scene, correcting orientation, and validating scale using simple reference geometry.

From there, physics and lighting are layered into the environment. A ground plane is configured as a matte object to properly receive shadows, while dome lighting is added to establish consistent global illumination. The radiance field is then linked to physical proxy geometry so that lighting and shadow interactions behave as expected.

The collider mesh exported from Marble is imported next, aligned with the splat volume, and enabled as a physics collider. While invisible in the final render, it governs how robots interact with surfaces such as floors, counters, and furniture.

At this stage, the environment behaves like a traditionally hand modeled simulation asset, despite having been generated by an AI model. To validate the setup, NVIDIA drops a Nova Carter robot into the scene, assigns a differential controller, and drives it through the kitchen environment using keyboard input. The robot respects collisions, rests correctly on the floor, and interacts naturally with the space.

From Isaac Sim’s perspective, the Marble generated world is no different from a manually authored USD environment. It’s becoming increasingly common to see generative worlds slot directly into robotics workflows. For robotics teams, this unlocks faster iteration, greater environment diversity, and more scalable sim to real testing. For the radiance field community, it marks another expansion of gaussian splats beyond visualization and capture, into physics-driven, embodied AI development.

Read the original NVIDIA blog here.

Thumbnail for Gaussian Splatting News episode 13

13:12

Watch · New every Monday

The Biggest Week Yet for Gaussian Splatting: Blender + Unreal

Episode 13 · Nov 16, 2026

Blender 5.3 is out, and Gaussian splats are now a native part of it: PLY and SPZ files import as their own point cloud type and render in EEVEE, Cycles and Workbench, with no add-on.

Featured

Recents

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Platforms

ReactVision Advanced VPS Turns Phone Scans Into Splats

ReactVision Advanced VPS in ViroReact 3.1.0 turns a one-minute phone scan into a map, mesh, GLB model, object map and Gaussian splat in one coordinate frame.

Michael Rubloff

Nov 16, 2026

Platforms

ReactVision Advanced VPS Turns Phone Scans Into Splats

ReactVision Advanced VPS in ViroReact 3.1.0 turns a one-minute phone scan into a map, mesh, GLB model, object map and Gaussian splat in one coordinate frame.

Michael Rubloff

Trending Articles
  1. TRENDING
    Loading...
  2. TRENDING
    Loading...
  3. TRENDING
    Loading...
Michael Rubloff

Written by Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

More from Michael Rubloff

More from Michael Rubloff

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

SuperSplat 3.9 Imports GSAF 4D Splats as Timeline Sequences

SuperSplat v3.9.0 imports GSAF 4D Gaussian splat files as timeline sequences, plays several sequences at once and adds a review table for multi-file imports.

Michael Rubloff

Nov 17, 2026

The SuperSplat editor in a browser window, editing a Gaussian splat of a snow-covered cabin in a pine forest

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

CARLA

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

Michael Rubloff

Nov 17, 2026

CARLA

Platforms

CARLA 1.0 Adds NVIDIA NuRec 26.04 Support

CARLA 1.0 adds NVIDIA NuRec 26.04 support, turning recorded real-world drives into simulated scenes with neural lidar, asset swapping and actor compositing.

Michael Rubloff

Nov 17, 2026

CARLA

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

News

Volumetric Media Town Hall Turns to 4D Gaussian Splats

The Metaverse Standards Forum holds its third Volumetric Media Town Hall on November 24, with 4D Gaussian splatting talks by Dymensium, Chronospace and Gracia.

Michael Rubloff

Nov 17, 2026

Metaverse Standards Forum

New to Gaussian Splatting? Start here

Radiance fields, explained from the ground up: what a Gaussian splat is, how to capture one, and which tools and gear to start with.

Newsletter

Keep up with the field.

New research, tools and captures from the Radiance Fields newsroom, in your inbox. Free, no spam.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.