Tools

MetalSplatter for Apple Vision Pro

Michael Rubloff

Michael Rubloff

Feb 4, 2024

Email
Copy Link
Twitter
Linkedin
Reddit
Whatsapp
MetalSplatter
MetalSplatter

MetalSplatter is a completely free and open source Gaussian Splatting viewer and Swift/Metal library for the Apple Vision Pro. It allows you to experience your captures in full stereo within the Vision Pro. I have gotten significantly more distracted by this than I anticipated, with my plans Friday and yesterday virtually disintegrating.

For those that have gotten their hands on a Vision Pro, MetalSplatter is currently on the Vision App Store to view Gaussian Splatting files.

It's a very easy set up, as it only requires a .ply trained with Gaussian Splatting. If you have any captures on Luma, Polycam, or Kiri Engine, you can simply download the .ply unzip the file and open it in MetalSplatter. If you are looking for demo captures to try out, I have linked three of mine for you to download!

The MetalSplatter library facilitates the rendering of frames with efficiency and clarity. Alongside, PLYIO serves as a robust module for reading both binary and ASCII PLY files, encouraging experimentation with 3D models. SplatIO, another critical component, interprets these PLY files as sets of splats, further enhancing the library's versatility.

For those eager to dive into the world of 3D Gaussian Splatting, MetalSplatter includes a SampleApp and a SampleBoxRenderer. These tools, although minimal, are designed to demonstrate the library's capabilities and assist developers in integrating MetalSplatter into their projects.

Despite its early-stage development, MetalSplatter is a work in progress with a vision for significant enhancements. Future updates aim to address current limitations, such as color accuracy, memory optimization, and API documentation. The roadmap includes advanced features like spherical harmonics and improved scalability, ensuring that MetalSplatter remains at the forefront of 3D rendering technology. Right now only .PLYs are accepted, but the developer has .Splat coming soon. Additionally, I have crashed my Vision Pro several times loading .plys across all of the current viewers, so if it crashes, don't be overly concerned. It will turn back on roughly 30 seconds later.

There currently is not any documentation, but that said, I am immensely happier that it released first and find it easy enough to navigate around without it.

MetalSplatter draws inspiration from several key implementations and insightful blog posts within the field, acknowledging the contributions of pioneers like Kevin Kwok, Aras Pranckevičius, and the authors of the original paper.

If there is interest, I have a large library of captures (2K+) that people can try for themselves. If anyone has suggestions on how to easily open source a portion of them, please let me know!

Currently it is the only native viewer for Gaussian Splatting on the Vision Pro, but to my understanding several companies are aiming to change that by the end of this upcoming week. For more information or to fork the code, please visit MetalSplatter's GitHub repository.

Featured

Featured

Featured

Platforms

splatviz: Interactive 3DGS Viewer and Python Editor

splatviz, an innovative interactive viewer available on GitHub offers real-time editing and visualization capabilities using a native Python GUI library.

Michael Rubloff

Jul 17, 2024

Platforms

splatviz: Interactive 3DGS Viewer and Python Editor

splatviz, an innovative interactive viewer available on GitHub offers real-time editing and visualization capabilities using a native Python GUI library.

Michael Rubloff

Jul 17, 2024

Platforms

splatviz: Interactive 3DGS Viewer and Python Editor

splatviz, an innovative interactive viewer available on GitHub offers real-time editing and visualization capabilities using a native Python GUI library.

Michael Rubloff

News

Amazon Prime Day Sales

Amazon Prime Day is here and with it are some deals that will help you train more NeRFs/3D Gaussian Splatting captures!

Michael Rubloff

Jul 16, 2024

News

Amazon Prime Day Sales

Amazon Prime Day is here and with it are some deals that will help you train more NeRFs/3D Gaussian Splatting captures!

Michael Rubloff

Jul 16, 2024

News

Amazon Prime Day Sales

Amazon Prime Day is here and with it are some deals that will help you train more NeRFs/3D Gaussian Splatting captures!

Michael Rubloff

Platforms

Three.js-based implemetation, GaussianSplats3D adds 2DGS Support

The Three.js-based implementation of Gaussian Splatting has officially added 2DGS support in v0.4.3.

Michael Rubloff

Jul 16, 2024

Platforms

Three.js-based implemetation, GaussianSplats3D adds 2DGS Support

The Three.js-based implementation of Gaussian Splatting has officially added 2DGS support in v0.4.3.

Michael Rubloff

Jul 16, 2024

Platforms

Three.js-based implemetation, GaussianSplats3D adds 2DGS Support

The Three.js-based implementation of Gaussian Splatting has officially added 2DGS support in v0.4.3.

Michael Rubloff

Research

3D Gaussian Ray Tracing

Today, things are taking an exciting step forward with the introduction of 3D Gaussian Ray Tracing (3DGRT).

Michael Rubloff

Jul 10, 2024

Research

3D Gaussian Ray Tracing

Today, things are taking an exciting step forward with the introduction of 3D Gaussian Ray Tracing (3DGRT).

Michael Rubloff

Jul 10, 2024

Research

3D Gaussian Ray Tracing

Today, things are taking an exciting step forward with the introduction of 3D Gaussian Ray Tracing (3DGRT).

Michael Rubloff

Trending articles

Trending articles

Trending articles

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

Jun 7, 2024

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

Jun 7, 2024

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

May 14, 2024

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

May 14, 2024

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

May 8, 2024

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

May 8, 2024

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff