Platforms

Wayve Announces PRISM-1

Michael Rubloff

Michael Rubloff

Jun 17, 2024

Email
Copy Link
Twitter
Linkedin
Reddit
Whatsapp
Wayve PRISM-1
Wayve PRISM-1

UK automated-driving company, Wayve, has announced the launch of PRISM-1, an innovative 4D reconstruction model designed to significantly enhance the testing and training of advanced driver assistance systems and autonomous driving technology. This is the first follow-up to Wayve’s Ghost Gym, which was unveiled back in late 2023. Ghost Gym is a neural simulator that uses NeRFs to efficiently test and validate end-to-end AI driving models in a safe, controlled virtual environment.

PRISM-1 represents a significant advance in 4D scene reconstruction. It enables the resimulation of complex and dynamic scenes with minimal engineering effort, emphasizing generalization and scalability. This approach avoids the need for explicit labels, scene graphs, and bounding boxes, ensuring efficiency even as scene complexity increases. This scalability makes PRISM-1 ideal for simulating complex urban environments. Unlike traditional methods that treat vehicles as rigid entities, PRISM-1 captures their dynamic nature, including behaviors like turning indicators and sudden braking.

Interestingly, PRISM-1 is using camera-only inputs, and therefore skirts the need for LiDAR-based units. While not confirmed yet, Wayve appears to be using Gaussian Splatting with PRISM-1, as the hallmark Gaussians are occasionally visible. 

While Radiance Fields are primarily known for their ability to represent a scene in hyper-realistic detail, it’s not their only feature. PRISM-1 adequately demonstrates this by identifying and tracking changes in the appearance of scene elements over time. It can further accurately resimulate complex dynamic scenarios by distinguishing between static and dynamic elements in a self-supervised manner. This extends to cyclists, pedestrians, and vehicles, which are all notoriously difficult to simulate because of their unpredictability.

Simulation plays a critical role in the development of autonomous driving. It provides a safe, repeatable, and cost-effective way to test and refine driving models, while also allowing for simulating long-tail problems. The challenge with real-world testing is that conditions can vary significantly between tests, even on the same stretch of road. 

Jamie Shotton, Chief Scientist at Wayve, stated,

"PRISM-1 bridges the gap between the real world and our simulator. By enhancing our simulation platform with accurate dynamic representations, Wayve can extensively test, validate, and fine-tune our AI models at scale. We are building Embodied AI technology that generalizes and scales. To achieve this, we continue to advance our end-to-end AI capabilities, not only in our driving models but also through enabling technologies like PRISM-1."

In conjunction with the launch of PRISM-1, Wayve has also released the WayveScenes101 Dataset, comprising 101 diverse driving scenarios from the UK and US. This dataset includes urban, suburban, and highway scenes under various weather and lighting conditions. Wayve aims for this dataset to support the AI research community in developing more robust and accurate scene representation models for driving. 

This announcement comes on the heels of their $1.05 billion Series C funding announcement in early May and aligns with the outset of CVPR, where the London based team will be displaying. For those attending, they are located at booth #1712 and have created a page with their speaking schedule

Future work will focus on further enhancing resimulation capabilities and exploring new ways to improve the accuracy and reliability of their simulation engine.

Featured

Featured

Featured

Platforms

splatviz: Interactive 3DGS Viewer and Python Editor

splatviz, an innovative interactive viewer available on GitHub offers real-time editing and visualization capabilities using a native Python GUI library.

Michael Rubloff

Jul 17, 2024

Platforms

splatviz: Interactive 3DGS Viewer and Python Editor

splatviz, an innovative interactive viewer available on GitHub offers real-time editing and visualization capabilities using a native Python GUI library.

Michael Rubloff

Jul 17, 2024

Platforms

splatviz: Interactive 3DGS Viewer and Python Editor

splatviz, an innovative interactive viewer available on GitHub offers real-time editing and visualization capabilities using a native Python GUI library.

Michael Rubloff

News

Amazon Prime Day Sales

Amazon Prime Day is here and with it are some deals that will help you train more NeRFs/3D Gaussian Splatting captures!

Michael Rubloff

Jul 16, 2024

News

Amazon Prime Day Sales

Amazon Prime Day is here and with it are some deals that will help you train more NeRFs/3D Gaussian Splatting captures!

Michael Rubloff

Jul 16, 2024

News

Amazon Prime Day Sales

Amazon Prime Day is here and with it are some deals that will help you train more NeRFs/3D Gaussian Splatting captures!

Michael Rubloff

Platforms

Three.js-based implemetation, GaussianSplats3D adds 2DGS Support

The Three.js-based implementation of Gaussian Splatting has officially added 2DGS support in v0.4.3.

Michael Rubloff

Jul 16, 2024

Platforms

Three.js-based implemetation, GaussianSplats3D adds 2DGS Support

The Three.js-based implementation of Gaussian Splatting has officially added 2DGS support in v0.4.3.

Michael Rubloff

Jul 16, 2024

Platforms

Three.js-based implemetation, GaussianSplats3D adds 2DGS Support

The Three.js-based implementation of Gaussian Splatting has officially added 2DGS support in v0.4.3.

Michael Rubloff

Research

3D Gaussian Ray Tracing

Today, things are taking an exciting step forward with the introduction of 3D Gaussian Ray Tracing (3DGRT).

Michael Rubloff

Jul 10, 2024

Research

3D Gaussian Ray Tracing

Today, things are taking an exciting step forward with the introduction of 3D Gaussian Ray Tracing (3DGRT).

Michael Rubloff

Jul 10, 2024

Research

3D Gaussian Ray Tracing

Today, things are taking an exciting step forward with the introduction of 3D Gaussian Ray Tracing (3DGRT).

Michael Rubloff

Trending articles

Trending articles

Trending articles

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

Jun 7, 2024

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

Jun 7, 2024

Platforms

Nerfstudio Releases gsplat 1.0

Just in time for your weekend, Ruilong Li and the team at Nerfstudio are bringing a big gift.

Michael Rubloff

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

May 14, 2024

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

May 14, 2024

News

SIGGRAPH 2024 Program Announced

The upcoming SIGGRAPH conference catalog has been released and the conference will be filled of radiance fields!

Michael Rubloff

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

May 8, 2024

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

May 8, 2024

Platforms

Google CloudNeRF: Zip-NeRF and CamP in the Cloud

It doesn't seem like a lot of people know this, but you can run CamP and Zip-NeRF in the cloud, straight through Google and it's actually super easy. It’s called CloudNeRF.

Michael Rubloff

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff