Apple Spatial Videos and the Future of Memory

Michael Rubloff

Michael Rubloff

Sep 13, 2023

Email
Copy Link
Twitter
Linkedin
Reddit
Whatsapp
Spatial Video
Spatial Video

Like many people, I was glued to my computer yesterday, watching the livestream of Apple's event. Despite my excitement of finally updating my phone's storage (too many NeRFs), what really pushed me over the edge was the acknowledgement of a brand new feature. Specifically Spatial Video, something that Apple briefly showcased in their unveiling of the Vision Pro headset earlier this year.

I have continually said that I believe the evolution of photography and memory capture has been in the beginning stages and this announcement only supercharges that belief.

Additionally, I think it's now clear that Apple shares the same vision that we are heading towards a future powered by completely photorealistic three dimensional memories. While the standard iPhone is an amazing capture device, it seems that Apple is fully preparing itself to provide even better tools to its consumers to allow for high quality captures and the ability to "relive" memories in full 3D. Meaning, you won't need to be wearing the headset to capture these spatial photos, like in the well intentioned, but unfortunately executed marketing video.

As Apple also showcased, it will be possible to share these captures across users and I believe that companies will begin scrambling to offer services that integrate seamlessly.

My bet is on Luma CEO, Amit Jain, who previous to starting Luma, worked on the headset.

Featuring Apple's first three-dimensional camera, Apple Vision Pro lets users capture, relive, and immerse themselves in favorite memories with Spatial Audio. Every spatial photo and video transports users back to a moment in time, like a celebration with friends or a special family gathering. Users can access their entire photo library on iCloud, and view their photos and videos at a life-size scale with brilliant color and spectacular detail.Apple Press ReleaseTweet

Apple knows that this is the future and they are not the only trillion dollar company publicly stating so. Google has publicly showcased their intention to move into NeRFs, and Meta's Mark Zuckerberg also highlighting NeRFs. With more and more companies joining the fray, I'm excited, but impatient.

Now Apple is beginning to put 3D capture at the square focus of their new phones into consumer hands. Platforms such as Luma also has been shipping their platform for close to a year, allowing anyone with an iPhone or access to a web browser to create a revisitable memory or interaction.

While the Spatial Video feature does not have a hard release date set yet, they are coming sooner than you think and I am further excited for Spatial Photos afterwards. Truthfully, I did not believe that this would be even showed at this event, but again I have underestimated the progress of technology.

If you're as impatient as I am, you can begin right now with NeRFs. We're undergoing a fundamental revolution in the ways that human life is documented and shared.

The iPhone 15 Pro starts at $999, while the iPhone 15 Pro Max starts at $1,199 .

Featured

Recents

Featured

Platforms

Into the Scaniverse: Scaniverse in VR

Scaniverse is now available on both the Quest 3 and 3S.

Michael Rubloff

Dec 10, 2024

Platforms

Into the Scaniverse: Scaniverse in VR

Scaniverse is now available on both the Quest 3 and 3S.

Michael Rubloff

Dec 10, 2024

Platforms

Into the Scaniverse: Scaniverse in VR

Scaniverse is now available on both the Quest 3 and 3S.

Michael Rubloff

Platforms

Reflct: Simple 3DGS Viewer for Ecommerce

The clean 3DGS viewer for Ecommerce with SH support has begun its closed beta.

Michael Rubloff

Dec 9, 2024

Platforms

Reflct: Simple 3DGS Viewer for Ecommerce

The clean 3DGS viewer for Ecommerce with SH support has begun its closed beta.

Michael Rubloff

Dec 9, 2024

Platforms

Reflct: Simple 3DGS Viewer for Ecommerce

The clean 3DGS viewer for Ecommerce with SH support has begun its closed beta.

Michael Rubloff

Research

3D Convex Splatting Radiance Field Rendering

3D Convex Splatting is another new way to render a Radiance Field. It is not Gaussian Splatting.

Michael Rubloff

Dec 6, 2024

Research

3D Convex Splatting Radiance Field Rendering

3D Convex Splatting is another new way to render a Radiance Field. It is not Gaussian Splatting.

Michael Rubloff

Dec 6, 2024

Research

3D Convex Splatting Radiance Field Rendering

3D Convex Splatting is another new way to render a Radiance Field. It is not Gaussian Splatting.

Michael Rubloff

Platforms

Frame Integrates Gaussian Splatting

Powered by Babylon.js, Frame now supports 3DGS imports.

Michael Rubloff

Dec 5, 2024

Platforms

Frame Integrates Gaussian Splatting

Powered by Babylon.js, Frame now supports 3DGS imports.

Michael Rubloff

Dec 5, 2024

Platforms

Frame Integrates Gaussian Splatting

Powered by Babylon.js, Frame now supports 3DGS imports.

Michael Rubloff