nerfstudio V0.3.2 Released

Happy Monday, everyone! Just before the weekend, nerfstudio announced nerfstudio V0.3.2.

In it there are several features of note, each of which could have commanded their own article, one of which already did, the very powerful nerfacto-huge.

Nerfacto-Huge

In my recent article, I took a look at Nerfacto-Huge and for those with 24GB of VRAM available, I highly recommend you check it out. It provides a big boost to sharpness, albeit at the cost of a longer process. My poor computer has gotten zero breaks in the last week.

Generfacto Text to 3D

So far there hadn't been much progress for text to 3D using NeRFs, outside of Luma's Imagine 3D, but Generfacto has now entered the ring! Generfacto can be run either using Stable Diffusion or nerfstudio's default option, Deepfloyd IF. The nerfstudio team recommends using Deepfloyd IF because its training time appears to be 4 times faster and provide better results.

While this is still in the very early days, we have repeatedly seen incredible rate of progress

nerfstudio on Mac

With all the large announcements, this one gets buried towards the bottom, but it's a massive announcement. Nerfstudio can run on Mac. I'll be honest, it's not the fastest in the world, but I have seen it for myself working on an M1 macbook. As far as I'm aware, this is the first NeRF platform to run locally, not using NVIDIA on the backend.

Here is the larger list of updates to nerfstudio V0.3.2.

• Add nerfacto-huge model

• Add text-to-3d model generfacto

• Support for CPU and M1/M2

• Support for rendering omni-directional stereo video

• Bug fixes