Zip-NeRF Added to nerfstudio

Michael Rubloff

Michael Rubloff

Feb 13, 2024

Email
Copy Link
Twitter
Linkedin
Reddit
Whatsapp
nerfstudio
nerfstudio

Last night a flurry of updates got pushed into nerfstudio. The most exciting of which is a pytorch implementation of Zip-NeRF.

Zip-NeRF is a strong NeRF method from the Google Research team. Once installed, it takes roughly 55 minutes to train on my computer.

Zip-NeRF is the latest 3rd party method to receive support within the Berkeley based studio and has been hotly request, since its paper's release. Late last year, Google researcher and paper author Jon Barron released the code to both CamP and Zip-NeRF. This implementation is different from the official release is this one is built on PyTorch.

In order to install Zip-NeRF, please follow the below instructions.

First, install nerfstudio and its dependencies. Then run:

pip install git+https://github.com/SuLvXiangXin/zipnerf-pytorch#subdirectory=extensions/cuda
pip install git+https://github.com/SuLvXiangXin/zipnerf-pytorch

Finally, install torch_scatter corresponding to your Cuda version(https://pytorch-geometric.com/whl/torch-2.0.1%2Bcu118.html).

In addition to this change, other commits featuring the following were also added.

Before and After



gsplat also received an update to V0.1.5, with the following additions:

  • Improved pytorch implementation of project_gaussians inside _torch_impl.py

  • Screen space blur compensation for rasterizing tiny gaussians from Mip-Splatting

  • Bugfixes

Featured

Recents

Featured

News

NeRFs Nominated for Regional Emmy

Rent a tuxedo. NeRFs are going to the Emmys.

Michael Rubloff

Sep 12, 2024

News

NeRFs Nominated for Regional Emmy

Rent a tuxedo. NeRFs are going to the Emmys.

Michael Rubloff

Sep 12, 2024

News

NeRFs Nominated for Regional Emmy

Rent a tuxedo. NeRFs are going to the Emmys.

Michael Rubloff

Research

Quadrature Fields

This method from the 3DGS MCMC team pushes NeRF rendering rates well into real time and up to 500fps.

Michael Rubloff

Sep 11, 2024

Research

Quadrature Fields

This method from the 3DGS MCMC team pushes NeRF rendering rates well into real time and up to 500fps.

Michael Rubloff

Sep 11, 2024

Research

Quadrature Fields

This method from the 3DGS MCMC team pushes NeRF rendering rates well into real time and up to 500fps.

Michael Rubloff

Platforms

Agisoft Metashape adds COLMAP Export to Standard License

Another state of the art SfM method just got a bit easier to use.

Michael Rubloff

Sep 9, 2024

Platforms

Agisoft Metashape adds COLMAP Export to Standard License

Another state of the art SfM method just got a bit easier to use.

Michael Rubloff

Sep 9, 2024

Platforms

Agisoft Metashape adds COLMAP Export to Standard License

Another state of the art SfM method just got a bit easier to use.

Michael Rubloff

News

Introducing View Dependent: A New Podcast Exploring the Future of 3D Tech

Join hosts Michael and MrNeRF as they explore the groundbreaking advancements in Radiance Field technology, from NeRFs to Gaussian Splatting, with insights from leading engineers, researchers, and industry veterans shaping the future of 3D tech.

Michael Rubloff

Sep 9, 2024

News

Introducing View Dependent: A New Podcast Exploring the Future of 3D Tech

Join hosts Michael and MrNeRF as they explore the groundbreaking advancements in Radiance Field technology, from NeRFs to Gaussian Splatting, with insights from leading engineers, researchers, and industry veterans shaping the future of 3D tech.

Michael Rubloff

Sep 9, 2024

News

Introducing View Dependent: A New Podcast Exploring the Future of 3D Tech

Join hosts Michael and MrNeRF as they explore the groundbreaking advancements in Radiance Field technology, from NeRFs to Gaussian Splatting, with insights from leading engineers, researchers, and industry veterans shaping the future of 3D tech.

Michael Rubloff