PinchDrop Unfolds Phone Photos as Splats on Vision Pro

PinchDrop v0.5.1 for Apple Vision Pro unfolds a Gaussian splat scene from a photo shown on a phone with a pinch, using ARKit image tracking and MetalSplatter.

PinchDrop v0.5.1 for Apple Vision Pro unfolds a Gaussian splat scene from a photo shown on a phone with a pinch, using ARKit image tracking and MetalSplatter.

Michael Rubloff

Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

PinchDrop

Bihe Xi has released PinchDrop v0.5.1, a Vision Pro app that unfolds a gaussian splat scene from a photo on a phone when the wearer pinches and opens a hand.

Each PinchDrop scene pairs one reference image with one prepared Gaussian model. When a scene is selected, the headset registers that image and its physical display size with ARKit, tracks the photo and the hand, samples the photo's colors and renders the paired scene locally. Nothing is trained, recognized in the cloud or transferred during the pinch.

The Xcode project ships four scenes with their phone photos, a Beijing ginkgo, Seljalandsfoss and two snowy Irkutsk streets, the scenes from the demo videos Xi has posted on X, including one on November 19. A PinchDropPreview target previews the reveal on an Apple silicon Mac, and the hand interaction needs a Vision Pro on visionOS 26 with Developer Mode. Rendering runs on a vendored copy of Sean Cier's MetalSplatter, the MIT licensed Swift renderer that already runs splats on Vision Pro.

Scene generation stays outside the app. A bundled script pairs a photo with a SOG v2, SPLAT, SPZ or compatible PLY scene and caps each scene at 650,000 Gaussians by default. The README covers making scenes with a free Mac app or, for noncommercial research, Apple's ML-SHARP model and shrinking them with PlayCanvas's splat-transform.

PinchDrop follows Walk Into Memory, the MIT licensed photo to splat pipeline and visionOS app Xi open sourced on October 28, which also builds on MetalSplatter and adds hand gestures that dissolve splats near the hand and set the scene swaying in a wind.

PinchDrop's original code and documentation are source-available under the PolyForm Noncommercial 1.0.0 license, and the four photographs and paired scenes are supplied for noncommercial use with the app. Apple licenses the ML-SHARP weights for noncommercial scientific research only, excluding product development, and PinchDrop does not distribute them.

PinchDrop is available now on GitHub.

Thumbnail for Gaussian Splatting News episode 13

13:12

Watch · New every Monday

The Biggest Week Yet for Gaussian Splatting: Blender + Unreal

Episode 13 · Nov 16, 2026

Blender 5.3 is out, and Gaussian splats are now a native part of it: PLY and SPZ files import as their own point cloud type and render in EEVEE, Cycles and Workbench, with no add-on.

Featured

Recents

Platforms

QuickSplat Previews Gaussian Splats With the Space Bar

QuickSplat v0.4.0 previews Gaussian splats on the space bar in Windows Explorer and macOS Finder, reading PLY, SPZ, SOG, SPLAT and KSPLAT files offline.

Michael Rubloff

Nov 21, 2026

Platforms

QuickSplat Previews Gaussian Splats With the Space Bar

QuickSplat v0.4.0 previews Gaussian splats on the space bar in Windows Explorer and macOS Finder, reading PLY, SPZ, SOG, SPLAT and KSPLAT files offline.

Michael Rubloff

Platforms

French Touch Factory Adds HD 4DGS Playback to Unity

French Touch Factory's ITHACA 4DGS package for Unity adds HD .trgz 4D Gaussian splat sequences, in which each splat follows its own screw motion over time.

Michael Rubloff

Nov 21, 2026

Platforms

French Touch Factory Adds HD 4DGS Playback to Unity

French Touch Factory's ITHACA 4DGS package for Unity adds HD .trgz 4D Gaussian splat sequences, in which each splat follows its own screw motion over time.

Michael Rubloff

Platforms

SplatBridge Now Edits Gaussian Splats Inside Unity

SplatBridge 1.3.2 layers up to four effects per Gaussian splat source, and its Unity Asset Store listing now documents in-editor editing and HTTP streaming.

Michael Rubloff

Nov 21, 2026

Platforms

SplatBridge Now Edits Gaussian Splats Inside Unity

SplatBridge 1.3.2 layers up to four effects per Gaussian splat source, and its Unity Asset Store listing now documents in-editor editing and HTTP streaming.

Michael Rubloff

Platforms

Shrunk Turns Phone Scans Into Hide-and-Seek Maps

Shrunk is a browser hide-and-seek game set in Gaussian splat homes, with seven free sample rooms and a $4.99 Home Pass that turns a phone scan into a map.

Michael Rubloff

Nov 20, 2026

Platforms

Shrunk Turns Phone Scans Into Hide-and-Seek Maps

Shrunk is a browser hide-and-seek game set in Gaussian splat homes, with seven free sample rooms and a $4.99 Home Pass that turns a phone scan into a map.

Michael Rubloff

Michael Rubloff

Written by Michael Rubloff

Michael is the Founder and Managing Editor of Radiancefields.com

More from Michael Rubloff

More from Michael Rubloff

Platforms

QuickSplat Previews Gaussian Splats With the Space Bar

QuickSplat v0.4.0 previews Gaussian splats on the space bar in Windows Explorer and macOS Finder, reading PLY, SPZ, SOG, SPLAT and KSPLAT files offline.

Michael Rubloff

Nov 21, 2026

QuickSplat

Platforms

QuickSplat Previews Gaussian Splats With the Space Bar

Michael Rubloff

Nov 21, 2026

QuickSplat

Platforms

QuickSplat Previews Gaussian Splats With the Space Bar

QuickSplat v0.4.0 previews Gaussian splats on the space bar in Windows Explorer and macOS Finder, reading PLY, SPZ, SOG, SPLAT and KSPLAT files offline.

Michael Rubloff

Nov 21, 2026

QuickSplat

Platforms

PinchDrop Unfolds Phone Photos as Splats on Vision Pro

PinchDrop v0.5.1 for Apple Vision Pro unfolds a Gaussian splat scene from a photo shown on a phone with a pinch, using ARKit image tracking and MetalSplatter.

Michael Rubloff

Nov 21, 2026

PinchDrop

Platforms

PinchDrop Unfolds Phone Photos as Splats on Vision Pro

Michael Rubloff

Nov 21, 2026

PinchDrop

Platforms

PinchDrop Unfolds Phone Photos as Splats on Vision Pro

PinchDrop v0.5.1 for Apple Vision Pro unfolds a Gaussian splat scene from a photo shown on a phone with a pinch, using ARKit image tracking and MetalSplatter.

Michael Rubloff

Nov 21, 2026

PinchDrop

Platforms

French Touch Factory Adds HD 4DGS Playback to Unity

French Touch Factory's ITHACA 4DGS package for Unity adds HD .trgz 4D Gaussian splat sequences, in which each splat follows its own screw motion over time.

Michael Rubloff

Nov 21, 2026

French Touch Factory

Platforms

French Touch Factory Adds HD 4DGS Playback to Unity

Michael Rubloff

Nov 21, 2026

French Touch Factory

Platforms

French Touch Factory Adds HD 4DGS Playback to Unity

French Touch Factory's ITHACA 4DGS package for Unity adds HD .trgz 4D Gaussian splat sequences, in which each splat follows its own screw motion over time.

Michael Rubloff

Nov 21, 2026

French Touch Factory

New to Gaussian Splatting? Start here

Radiance fields, explained from the ground up: what a Gaussian splat is, how to capture one, and which tools and gear to start with.

Newsletter

Keep up with the field.

New research, tools and captures from the Radiance Fields newsroom, in your inbox. Free, no spam.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.

Gaussian Splatting News on YouTube

The week in radiance fields, every Monday.