ASU Open Sources Open4DGS for Genlock-Free 4D Gaussian Splatting

Open4DGS from Arizona State University turns consumer multi-camera video into 4D Gaussian splats, using a sub-frame sync solver in place of hardware genlock.

Open4DGS from Arizona State University turns consumer multi-camera video into 4D Gaussian splats, using a sub-frame sync solver in place of hardware genlock.

Michael Rubloff

Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

Open4DGS

Arizona State University's Narrative and Emerging Media Program has detailed Open4DGS, a pipeline that turns multi-camera footage from consumer cameras into 4D Gaussian splatting sequences.

Open4DGS is built for rigs without hardware genlock, assembled from rolling shutter cameras such as GoPros, Sony action cameras or mixed consumer setups. The project page puts a genlocked array of broadcast global shutter cameras at tens of thousands of dollars. Backblaze's open source 4D splatting template, published in October, starts from video that is already synchronized.

The pipeline runs in seven stages. Frames are extracted and aligned by timecode, cameras are calibrated with COLMAP, and foregrounds are masked with Background Matting V2 or SAM 2. A solver script, calculate-sync.py, then estimates each camera's sub-frame timing offset and rolling shutter readout by tracking epipolar flow across calibrated camera pairs, with an example readout of 15.0 ms for a Sony RX0 II at 60 fps. When its closed loop consistency checks fail, the solver falls back to timecode alone.

Open4DGS matches points with RoMa v2 across cameras and MEMFOF across time. Points moving faster than 4.0 spacings per frame trigger one frame sub-keyframes, and training gives those fast frames additional visits.

The training core builds on TRiGS, a method Yeom et al. posted to arXiv in April, and its reference code TriGSVanilla. In Open4DGS, each primitive's translation and rotation are optimized jointly as a single twist, with quadratic Bézier control points modeling curved paths. Open4DGS fixes the canonical primitive count and recycles low opacity slots into active regions, so GPU memory stays constant, and it splits long captures into temporal chunks. Output is a .trigsbin timeline plus per frame PLY files for Blender, Unreal Engine and WebGL viewers, and a viewer shows the reconstruction while it trains.

The Open4DGS project page credits the work to the NEM Program, part of ASU’s Sidney Poitier New American Film School, and lists Arvin Tehrani of Contrast Media Labs, Rory Mitchell, Ryat Yezbick and Nonny de la Peña as its authors. The open source release was driven by de la Peña, the program’s founding director, who bought a capture rig for ASU’s Narrative and Emerging Media program and hired Contrast Media Labs to write the open source code to help advance the industry and community.

The page also credits the open source work Open4DGS builds on, naming TriGSVanilla and TRiGS, RoMa v2, MEMFOF from the MSU Video Group, SAM 2 from Meta, Background Matting V2, gsplat and COLMAP. The software is licensed under MIT and AGPL-3.0.

The code is split across two repositories. Open4DGS-Core prepares synchronized multi-camera video, initializes dynamic Gaussian scenes and exports TRiGS reconstructions, and training lives in the companion Open4DGS-Trigs repository under AGPL-3.0. The main Linux setup was exercised on Ubuntu 24.04 with Python 3.11, CUDA 12.8 and an NVIDIA RTX 3090, a Windows 11 configuration on an RTX PRO 6000 Blackwell is reported, and WSL 2 has not yet been validated.

Two example datasets are planned for a separate Open4DGS-Datasets repository, and the developers told Radiance Fields they will carry a research and education license. The roadmap, which carries no committed dates, lists prep and training time improvements, a Unity plugin with a sample project, web SDKs based on Spark and three.js, an 8th Wall sample project, and compression and streaming.

The pipeline is detailed on the Open4DGS project page.

Thumbnail for Gaussian Splatting News episode 13

13:12

Watch · New every Monday

The Biggest Week Yet for Gaussian Splatting: Blender + Unreal

Episode 13 · Nov 16, 2026

Blender 5.3 is out, and Gaussian splats are now a native part of it: PLY and SPZ files import as their own point cloud type and render in EEVEE, Cycles and Workbench, with no add-on.

Featured

Recents

Platforms

ANNX Studio 1.6.1 Brings MCMC and Xsplat Training to Mac

ANNX Studio 1.6.1 brings MCMC, Xsplat and Default (gsplat) training to Apple Silicon Macs and adds a live preview for inspecting each model as it trains.

Michael Rubloff

Nov 18, 2026

Platforms

ANNX Studio 1.6.1 Brings MCMC and Xsplat Training to Mac

ANNX Studio 1.6.1 brings MCMC, Xsplat and Default (gsplat) training to Apple Silicon Macs and adds a live preview for inspecting each model as it trains.

Michael Rubloff

Platforms

Esri Makes ArcGIS Reality Server Generally Available

ArcGIS Reality Server is generally available with ArcGIS Enterprise 12.2, adding self-hosted, distributed processing of drone imagery into Gaussian splats.

Michael Rubloff

Nov 18, 2026

Platforms

Esri Makes ArcGIS Reality Server Generally Available

ArcGIS Reality Server is generally available with ArcGIS Enterprise 12.2, adding self-hosted, distributed processing of drone imagery into Gaussian splats.

Michael Rubloff

News

Cornell Tech's Pentimento Takes ACADIA'26 Best Paper

Pentimento from Cornell Tech and CITA won Best Paper at ACADIA'26, registering smart-glasses video splats to a design model to document reclaimed-timber builds.

Michael Rubloff

Nov 18, 2026

News

Cornell Tech's Pentimento Takes ACADIA'26 Best Paper

Pentimento from Cornell Tech and CITA won Best Paper at ACADIA'26, registering smart-glasses video splats to a design model to document reclaimed-timber builds.

Michael Rubloff

News

DJI Names Winners of Its 3D Heritage Contest

DJI names winners of its World Heritage 3D Conservation Initiative, a DJI Reality flythrough contest open to mesh, 3D Gaussian splatting and point cloud models.

Michael Rubloff

Nov 18, 2026

News

DJI Names Winners of Its 3D Heritage Contest

DJI names winners of its World Heritage 3D Conservation Initiative, a DJI Reality flythrough contest open to mesh, 3D Gaussian splatting and point cloud models.

Michael Rubloff

Trending Articles
  1. TRENDING
    Loading...
  2. TRENDING
    Loading...
  3. TRENDING
    Loading...
Michael Rubloff

Written by Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

More from Michael Rubloff

More from Michael Rubloff

News

ASU Open Sources Open4DGS for Genlock-Free 4D Gaussian Splatting

Open4DGS from Arizona State University turns consumer multi-camera video into 4D Gaussian splats, using a sub-frame sync solver in place of hardware genlock.

Michael Rubloff

Nov 18, 2026

Open4DGS

News

ASU Open Sources Open4DGS for Genlock-Free 4D Gaussian Splatting

Michael Rubloff

Nov 18, 2026

Open4DGS

News

ASU Open Sources Open4DGS for Genlock-Free 4D Gaussian Splatting

Open4DGS from Arizona State University turns consumer multi-camera video into 4D Gaussian splats, using a sub-frame sync solver in place of hardware genlock.

Michael Rubloff

Nov 18, 2026

Open4DGS

Platforms

ANNX Studio 1.6.1 Brings MCMC and Xsplat Training to Mac

ANNX Studio 1.6.1 brings MCMC, Xsplat and Default (gsplat) training to Apple Silicon Macs and adds a live preview for inspecting each model as it trains.

Michael Rubloff

Nov 18, 2026

A Gaussian splat reconstruction of a traditional Korean pavilion, from the ANNX Studio website

Platforms

ANNX Studio 1.6.1 Brings MCMC and Xsplat Training to Mac

Michael Rubloff

Nov 18, 2026

A Gaussian splat reconstruction of a traditional Korean pavilion, from the ANNX Studio website

Platforms

ANNX Studio 1.6.1 Brings MCMC and Xsplat Training to Mac

ANNX Studio 1.6.1 brings MCMC, Xsplat and Default (gsplat) training to Apple Silicon Macs and adds a live preview for inspecting each model as it trains.

Michael Rubloff

Nov 18, 2026

A Gaussian splat reconstruction of a traditional Korean pavilion, from the ANNX Studio website

Platforms

Esri Makes ArcGIS Reality Server Generally Available

ArcGIS Reality Server is generally available with ArcGIS Enterprise 12.2, adding self-hosted, distributed processing of drone imagery into Gaussian splats.

Michael Rubloff

Nov 18, 2026

An Esri graphic showing a 3D reality-mapped city with a diagram of ArcGIS Pro sending processing from ArcGIS Enterprise to ArcGIS Reality Server

Platforms

Esri Makes ArcGIS Reality Server Generally Available

Michael Rubloff

Nov 18, 2026

An Esri graphic showing a 3D reality-mapped city with a diagram of ArcGIS Pro sending processing from ArcGIS Enterprise to ArcGIS Reality Server

Platforms

Esri Makes ArcGIS Reality Server Generally Available

ArcGIS Reality Server is generally available with ArcGIS Enterprise 12.2, adding self-hosted, distributed processing of drone imagery into Gaussian splats.

Michael Rubloff

Nov 18, 2026

An Esri graphic showing a 3D reality-mapped city with a diagram of ArcGIS Pro sending processing from ArcGIS Enterprise to ArcGIS Reality Server

New to Gaussian Splatting? Start here

Radiance fields, explained from the ground up: what a Gaussian splat is, how to capture one, and which tools and gear to start with.

Newsletter

Keep up with the field.

New research, tools and captures from the Radiance Fields newsroom, in your inbox. Free, no spam.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.