News|Platforms

TurboNeRF 0.0.9 Released

Michael Rubloff

Apr 20, 2023

TurboNeRF Logo
TurboNeRF Logo

On 4/10/2023, James Perlman released version 0.0.9 of TurboNeRF. Since we last covered his progress, there have been several product improvement updates including a higher reconstruction quality, export the dataset, and the cameras are adjustable!

Perlman has also stated that saving and loading snapshots is now running on his local device, but will be coming on a future update. Additionally, multiple NeRFs that can be rendered simultaneously will be coming soon!

James is also livestreaming the creation of TurboNeRF here if you would like to follow along.

Download the newest version here:

A new version of the TurboNeRF core binary is now available! PyTurboNeRF 0.0.9
A new version of the Blender addon is now available. TurboNeRF-Blender 0.0.9

Among those of note in each version are:

TurboNeRF 0.0.9

  • The near and far clipping planes are previewable

  • Fixed a bug where (randomly) after a while, blender would just render the same frame over and over again, leading to incorrect output.

  • Fixed a potential bug in the raymarcher

TurboNeRF 0.0.8

  • Significant increase in reconstruction quality and convergence speed, and a decrease in cloudiness

  • A lot of my real scenes I don't have to clip so close to the subject anymore.

  • Identified a mathematical error in the back propagation algorithm and fixed it.

TurboNeRF 0.0.7

  • Reset Training button added

  • Camera pose loading & image loading have been split into 2 steps

  • You can see the progress of images loading instead of just waiting as the ui hangs (good for larger datasets)

TurboNeRF 0.0.6

  • Fixed a bug where resizing the Blender window would crash PyTurboNeRF

  • More robust raymarching (less freezing during renders/previews) + enable using shift x & y properties on Blender camera

  • Fixes the divide-by-zero issue (affects scenes where input images have an alpha channel)

    👍
  • You can now see the training images composited in with the NeRF (show near/far clipping planes)! This is different from NeRFStudio & Luma AI. The images are composited IN the scene instead of ontop of the scene, and the images can intersect the volumes. Try bringing your training images as close to the subject as possible without intersecting anything. Near/far planes can be adjusted for all cameras on on a per-camera basis.

  • QUALITY IMPROVEMENT: Thanks to some tips from https://github.com/cheind/pure-torch-ngp/blob/develop/torchngp/training.py#L301-L314 I have implemented the "random background color" training technique... which involved updating the manual gradients. it was a headache but it leads to faster convergence, and does not rely on using alpha loss.

  • DATASET ADJUSTMENTS: besides being able to adjust the near/far plane per-camera, you can also just the camera transforms themselves. I'd recommend against updating single cameras. But there is now an empty object generated inside the NeRF called CAMERAS and you can grab and scale this object.

  • PRO TIP: Grab and scale the CAMERAS object such that the subject of your scene fits into the 1x1x1 cube (the NeRF object has a wireframe cube associated with it. try to fit your subject inside this box).

  • HOT RELOADING: Adjustments made to the dataset currently only apply while in preview mode. However you can make adjustments while training

    🙂

TurboNeRF 0.0.5

  • Training algorithm should be approximately the same as 0.0.4, though I have made minor adjustments & optimizations

  • "Limit Training" checkbox lets you set a maximum number of steps to train to

  • Progress bar shows you what percentage of training steps are complete

  • Live count of number of steps (throttled to 4 updates per second to preserve UI responsiveness)

  • Live update of loss value (L1 smoothed loss, should report MSE & PSNR too at some point maybe?)

  • Update preview checkbox allows you to enable/disable the model from being regularly re-rendered ~ Model updates will still be rendered if you pan around it

  • Slider for setting # of steps between updates

  • Preview NeRF button automatically sets blender to TurboNeRF renderer & render preview configuration - Fixed bug where setting TurboNeRF render preview configuration would crash before you had started training a model

Check out some of the renders that people have been creating through TurboNeRF!

https://twitter.com/Beehibiki/status/1642367719071977473https://twitter.com/jperldev/status/1642323097540804609
https://twitter.com/smallfly/status/1647716670662664193https://twitter.com/felipeer/status/1636088549203124228

Featured

Featured

Featured

Research

Shrinking 3DGS File Size

Gaussian Splatting has quickly become one of the most exciting research topics in Radiance Fields, thanks to its fast training, real time rendering rates, and easy to create pipeline. The one critique that emerged was the resulting file size from captures, often venturing into the high hundreds of megabytes and up.

Michael Rubloff

Apr 11, 2024

Research

Shrinking 3DGS File Size

Gaussian Splatting has quickly become one of the most exciting research topics in Radiance Fields, thanks to its fast training, real time rendering rates, and easy to create pipeline. The one critique that emerged was the resulting file size from captures, often venturing into the high hundreds of megabytes and up.

Michael Rubloff

Apr 11, 2024

Research

Shrinking 3DGS File Size

Gaussian Splatting has quickly become one of the most exciting research topics in Radiance Fields, thanks to its fast training, real time rendering rates, and easy to create pipeline. The one critique that emerged was the resulting file size from captures, often venturing into the high hundreds of megabytes and up.

Michael Rubloff

4/11/24

Platforms

Luma AI Android Released

Native Android support from Luma AI is finally here. Of all the questions about Luma features I get, Android support is routinely at the top of the list.

Michael Rubloff

Apr 10, 2024

Platforms

Luma AI Android Released

Native Android support from Luma AI is finally here. Of all the questions about Luma features I get, Android support is routinely at the top of the list.

Michael Rubloff

Apr 10, 2024

Platforms

Luma AI Android Released

Native Android support from Luma AI is finally here. Of all the questions about Luma features I get, Android support is routinely at the top of the list.

Michael Rubloff

4/10/24

Research

PhysAvatar's Dynamic Dances

Playing as yourself in a video game has always seemed like a fun idea. Now, we're one step closer to making that a reality with PhysAvatar.

Michael Rubloff

Apr 9, 2024

Research

PhysAvatar's Dynamic Dances

Playing as yourself in a video game has always seemed like a fun idea. Now, we're one step closer to making that a reality with PhysAvatar.

Michael Rubloff

Apr 9, 2024

Research

PhysAvatar's Dynamic Dances

Playing as yourself in a video game has always seemed like a fun idea. Now, we're one step closer to making that a reality with PhysAvatar.

Michael Rubloff

4/9/24

Research

RealmDreamer's Generative Scenes

Since the unveiling of the Sora's large-scale generative Radiance Fields, the tech world has been buzzing with anticipation about the future of 3D scene generation. There hasn't been much public work since then showcasing what could be coming, but today we're looking at RealmDreamer, which creates scene level generations based on original text prompts.

Michael Rubloff

Apr 11, 2024

Research

RealmDreamer's Generative Scenes

Since the unveiling of the Sora's large-scale generative Radiance Fields, the tech world has been buzzing with anticipation about the future of 3D scene generation. There hasn't been much public work since then showcasing what could be coming, but today we're looking at RealmDreamer, which creates scene level generations based on original text prompts.

Michael Rubloff

Apr 11, 2024

Research

RealmDreamer's Generative Scenes

Since the unveiling of the Sora's large-scale generative Radiance Fields, the tech world has been buzzing with anticipation about the future of 3D scene generation. There hasn't been much public work since then showcasing what could be coming, but today we're looking at RealmDreamer, which creates scene level generations based on original text prompts.

Michael Rubloff

4/11/24

Trending articles

Trending articles

Trending articles

Platforms

Luma AI Android Released

Native Android support from Luma AI is finally here. Of all the questions about Luma features I get, Android support is routinely at the top of the list.

Michael Rubloff

Apr 10, 2024

Platforms

Luma AI Android Released

Native Android support from Luma AI is finally here. Of all the questions about Luma features I get, Android support is routinely at the top of the list.

Michael Rubloff

Apr 10, 2024

Platforms

Luma AI Android Released

Native Android support from Luma AI is finally here. Of all the questions about Luma features I get, Android support is routinely at the top of the list.

Michael Rubloff

Apr 10, 2024

Research

RadSplat's Hybrid NeRFs and 3DGS

Excitingly, we're seeing the arrival of the first result of another widely hyped event. The meeting of NeRFs and Gaussian Splatting.

Michael Rubloff

Mar 21, 2024

Research

RadSplat's Hybrid NeRFs and 3DGS

Excitingly, we're seeing the arrival of the first result of another widely hyped event. The meeting of NeRFs and Gaussian Splatting.

Michael Rubloff

Mar 21, 2024

Research

RadSplat's Hybrid NeRFs and 3DGS

Excitingly, we're seeing the arrival of the first result of another widely hyped event. The meeting of NeRFs and Gaussian Splatting.

Michael Rubloff

Mar 21, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Tools

splaTV: Dynamic Gaussian Splatting Viewer

Kevin Kwok, perhaps better known as Antimatter15, has released something amazing: splaTV.

Michael Rubloff

Mar 15, 2024

Interview

Gaussian Splatting Brings Art Exhibitions Online with Yulei

The advent of radiance fields represents a transformative leap in event photography, aiming to give people the feeling of attending an event asynchronously. Artist Yulei's recent demonstration serves as a compelling example of this technological progression.

Michael Rubloff

Feb 22, 2024

Interview

Gaussian Splatting Brings Art Exhibitions Online with Yulei

The advent of radiance fields represents a transformative leap in event photography, aiming to give people the feeling of attending an event asynchronously. Artist Yulei's recent demonstration serves as a compelling example of this technological progression.

Michael Rubloff

Feb 22, 2024

Interview

Gaussian Splatting Brings Art Exhibitions Online with Yulei

The advent of radiance fields represents a transformative leap in event photography, aiming to give people the feeling of attending an event asynchronously. Artist Yulei's recent demonstration serves as a compelling example of this technological progression.

Michael Rubloff

Feb 22, 2024

Recent articles

Recent articles

Research

Shrinking 3DGS File Size

Gaussian Splatting has quickly become one of the most exciting research topics in Radiance Fields, thanks to its fast training, real time rendering rates, and easy to create pipeline. The one critique that emerged was the resulting file size from captures, often venturing into the high hundreds of megabytes and up.

Michael Rubloff

Apr 11, 2024

3dgs compress

Research

Shrinking 3DGS File Size

Gaussian Splatting has quickly become one of the most exciting research topics in Radiance Fields, thanks to its fast training, real time rendering rates, and easy to create pipeline. The one critique that emerged was the resulting file size from captures, often venturing into the high hundreds of megabytes and up.

Michael Rubloff

Apr 11, 2024

3dgs compress

Platforms

Luma AI Android Released

Native Android support from Luma AI is finally here. Of all the questions about Luma features I get, Android support is routinely at the top of the list.

Michael Rubloff

Apr 10, 2024

Platforms

Luma AI Android Released

Native Android support from Luma AI is finally here. Of all the questions about Luma features I get, Android support is routinely at the top of the list.

Michael Rubloff

Apr 10, 2024

Research

PhysAvatar's Dynamic Dances

Playing as yourself in a video game has always seemed like a fun idea. Now, we're one step closer to making that a reality with PhysAvatar.

Michael Rubloff

Apr 9, 2024

Research

PhysAvatar's Dynamic Dances

Playing as yourself in a video game has always seemed like a fun idea. Now, we're one step closer to making that a reality with PhysAvatar.

Michael Rubloff

Apr 9, 2024