News

Apple Spatial Videos and the Future of Memory

Michael Rubloff

Michael Rubloff

Sep 13, 2023

Email
Copy Link
Twitter
Linkedin
Reddit
Whatsapp
Spatial Video
Spatial Video

Like many people, I was glued to my computer yesterday, watching the livestream of Apple's event. Despite my excitement of finally updating my phone's storage (too many NeRFs), what really pushed me over the edge was the acknowledgement of a brand new feature. Specifically Spatial Video, something that Apple briefly showcased in their unveiling of the Vision Pro headset earlier this year.

I have continually said that I believe the evolution of photography and memory capture has been in the beginning stages and this announcement only supercharges that belief.

Additionally, I think it's now clear that Apple shares the same vision that we are heading towards a future powered by completely photorealistic three dimensional memories. While the standard iPhone is an amazing capture device, it seems that Apple is fully preparing itself to provide even better tools to its consumers to allow for high quality captures and the ability to "relive" memories in full 3D. Meaning, you won't need to be wearing the headset to capture these spatial photos, like in the well intentioned, but unfortunately executed marketing video.

As Apple also showcased, it will be possible to share these captures across users and I believe that companies will begin scrambling to offer services that integrate seamlessly.

My bet is on Luma CEO, Amit Jain, who previous to starting Luma, worked on the headset.

Featuring Apple's first three-dimensional camera, Apple Vision Pro lets users capture, relive, and immerse themselves in favorite memories with Spatial Audio. Every spatial photo and video transports users back to a moment in time, like a celebration with friends or a special family gathering. Users can access their entire photo library on iCloud, and view their photos and videos at a life-size scale with brilliant color and spectacular detail.Apple Press ReleaseTweet

Apple knows that this is the future and they are not the only trillion dollar company publicly stating so. Google has publicly showcased their intention to move into NeRFs, and Meta's Mark Zuckerberg also highlighting NeRFs. With more and more companies joining the fray, I'm excited, but impatient.

Now Apple is beginning to put 3D capture at the square focus of their new phones into consumer hands. Platforms such as Luma also has been shipping their platform for close to a year, allowing anyone with an iPhone or access to a web browser to create a revisitable memory or interaction.

While the Spatial Video feature does not have a hard release date set yet, they are coming sooner than you think and I am further excited for Spatial Photos afterwards. Truthfully, I did not believe that this would be even showed at this event, but again I have underestimated the progress of technology.

If you're as impatient as I am, you can begin right now with NeRFs. We're undergoing a fundamental revolution in the ways that human life is documented and shared.

The iPhone 15 Pro starts at $999, while the iPhone 15 Pro Max starts at $1,199 .

Featured

Featured

Featured

Research

Frustum Volume Caching

A criticism of NeRFs is their rendering rates. Quietly a couple of papers have been published over the last two months which push NeRFs into real time rates.

Michael Rubloff

Jul 26, 2024

Research

Frustum Volume Caching

A criticism of NeRFs is their rendering rates. Quietly a couple of papers have been published over the last two months which push NeRFs into real time rates.

Michael Rubloff

Jul 26, 2024

Research

Frustum Volume Caching

A criticism of NeRFs is their rendering rates. Quietly a couple of papers have been published over the last two months which push NeRFs into real time rates.

Michael Rubloff

Research

N-Dimensional Gaussians for Fitting of High Dimensional Functions

It significantly improves the fidelity of reflections and other view-dependent effects, making scenes look more realistic.

Michael Rubloff

Jul 24, 2024

Research

N-Dimensional Gaussians for Fitting of High Dimensional Functions

It significantly improves the fidelity of reflections and other view-dependent effects, making scenes look more realistic.

Michael Rubloff

Jul 24, 2024

Research

N-Dimensional Gaussians for Fitting of High Dimensional Functions

It significantly improves the fidelity of reflections and other view-dependent effects, making scenes look more realistic.

Michael Rubloff

Platforms

Luma AI launches Loops for Dream Machine

Luma AI is starting the week off hot, with the release of Loops.

Michael Rubloff

Jul 22, 2024

Platforms

Luma AI launches Loops for Dream Machine

Luma AI is starting the week off hot, with the release of Loops.

Michael Rubloff

Jul 22, 2024

Platforms

Luma AI launches Loops for Dream Machine

Luma AI is starting the week off hot, with the release of Loops.

Michael Rubloff

Platforms

SuperSplat adds Histogram Editing

PlayCanvas is back with a new update to SuperSplat. It's the release of v0.22.2 and then the quick update to v0.24.0.

Michael Rubloff

Jul 18, 2024

Platforms

SuperSplat adds Histogram Editing

PlayCanvas is back with a new update to SuperSplat. It's the release of v0.22.2 and then the quick update to v0.24.0.

Michael Rubloff

Jul 18, 2024

Platforms

SuperSplat adds Histogram Editing

PlayCanvas is back with a new update to SuperSplat. It's the release of v0.22.2 and then the quick update to v0.24.0.

Michael Rubloff

Trending articles

Trending articles

Trending articles

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

Jun 7, 2024

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

Jun 7, 2024

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

May 14, 2024

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

May 14, 2024

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

May 8, 2024

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

May 8, 2024

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff