Gauzilla adds Segmentation and Annotation

Michael Rubloff

Michael Rubloff

Mar 1, 2024

Email
Copy Link
Twitter
Linkedin
Reddit
Whatsapp
Gauzilla
Gauzilla

Late last year, we explored Gauzilla, a Gaussian Splatting viewer developed by Josh Sato and crafted in Rust. A quick refresher: Gauzilla utilizes WebAssembly (WASM) for extensive compatibility and is an open-source (MIT License) 3D Gaussian Splatting (3DGS) renderer designed for efficient operation within web browsers. It appears Sato has been hard at work enhancing Gauzilla's capabilities, promising a host of further advancements in the pipeline.

Through radiance fields, we're able to achieve a hyperrealistic output of what's been captured. Sato aims to elevate this further by introducing a interactive 3D Gaussian segmentation and annotation system that operates entirely within a web browser. It utilizes a state-of-the-art vision transformer (ViT) based segmentation model. This unique approach allows for completely serverless operations and GPU independent inferencing.

This update allows users to segment each object and provide specific annotations for them. Depending on the use case, different documentation may prove more useful. For instance, in retail, details like SKU, available sizing, and return policy are invaluable. Coupled with a semantic model such as GARField, it's conceivable that this process could be automated.

Additional demonstrations made available by Sato underscore Gauzilla's impressive performance in-browser, although a relatively powerful GPU may be helpful. Currently, Gauzilla operates using WebGL, but there's speculation about a transition to WebGPU, promising significant performance enhancements.

This technology has the potential to revolutionize a multitude of industries. Sato has shown radiance fields' applicability within the retail sector—a behemoth industry poised to reap substantial benefits from this technology. For consumers, this translates to more efficient item location, enhanced quality assessment, and well-informed purchasing decisions.

From a commercial perspective, these innovations pave the way for improved inventory management, product visualization, immersive virtual reality experiences, and the maintenance of high standards across stores. For example, entities like McDonald's could leverage this for asynchronous oversight of branding standards among franchisees.

Gauzilla remains MIT Licensed, inviting further exploration and development. Find Gauzilla on its GitHub page and follow Sato on LinkedIn for updates to the project.

Featured

Recents

Featured

Research

How EVER (Exact Volumetric Ellipsoid Rendering) Does This Work?

Another Ray Tracing Radiance Field emerges, this time from Google.

Michael Rubloff

Oct 3, 2024

Research

How EVER (Exact Volumetric Ellipsoid Rendering) Does This Work?

Another Ray Tracing Radiance Field emerges, this time from Google.

Michael Rubloff

Oct 3, 2024

Research

How EVER (Exact Volumetric Ellipsoid Rendering) Does This Work?

Another Ray Tracing Radiance Field emerges, this time from Google.

Michael Rubloff

Platforms

DigitalCarbon Joins Y Combinator for Radiance Field Solutions

New company, DigitalCarbon has been accepted into Y Combinator to pursue Radiance Field reconstructions.

Michael Rubloff

Oct 2, 2024

Platforms

DigitalCarbon Joins Y Combinator for Radiance Field Solutions

New company, DigitalCarbon has been accepted into Y Combinator to pursue Radiance Field reconstructions.

Michael Rubloff

Oct 2, 2024

Platforms

DigitalCarbon Joins Y Combinator for Radiance Field Solutions

New company, DigitalCarbon has been accepted into Y Combinator to pursue Radiance Field reconstructions.

Michael Rubloff

Platforms

Chaos V-Ray 7 to support Gaussian Splatting

3DGS is now part of V Ray 7's beta, paving the way for use in platforms like 3ds Max and Maya.

Michael Rubloff

Oct 1, 2024

Platforms

Chaos V-Ray 7 to support Gaussian Splatting

3DGS is now part of V Ray 7's beta, paving the way for use in platforms like 3ds Max and Maya.

Michael Rubloff

Oct 1, 2024

Platforms

Chaos V-Ray 7 to support Gaussian Splatting

3DGS is now part of V Ray 7's beta, paving the way for use in platforms like 3ds Max and Maya.

Michael Rubloff

Platforms

Kiri Engine Gaussian Splatting Blender Add-On

Industry standard platform, Blender is getting another big 3DGS boost. This time from Kiri Engine.

Michael Rubloff

Sep 30, 2024

Platforms

Kiri Engine Gaussian Splatting Blender Add-On

Industry standard platform, Blender is getting another big 3DGS boost. This time from Kiri Engine.

Michael Rubloff

Sep 30, 2024

Platforms

Kiri Engine Gaussian Splatting Blender Add-On

Industry standard platform, Blender is getting another big 3DGS boost. This time from Kiri Engine.

Michael Rubloff