Week 2 - Discussion [24.4 - 29.4]

[git-bauerseb]

Discussion for Week 2 for 3DSSL.

[git-bauerseb]

I had some issues using pyvista/dreifus. The problem disappeared when I set the following variable

export MESA_LOADER_DRIVER_OVERRIDE=i965

Maybe it helps someone encountering the same problem.

[git-bauerseb]

In order to understand NeRF implementation, I took the original Tensorflow implementation and reimplemented it in PyTorch.

They provided a very simple (TinyNeRF) implementation which is relatively easy to understand. I'll provide the Jupyter Notebook I used later on.

Here is the result after 10000 Iterations, using uniform ray sampling (12 samples):

What I still need to figure out is how to render novel views (the image above shows the reconstruction of 12th camera image). For this, I'll need to create a path and some look at function to look at the target vector.

Also, since our end goal is to explore surface reconstruction, I'll try to use marching cubes to extract a mesh (as in original NeRF implementation)

[gutsuo]

In conda env I had to remove +cu113 argument from the version as it could not find a version that satisfies it, in addition to tinycudann package as well. Finally when I launched ns-viewer it reported that the file in the hdd does not exist.

[git-bauerseb]

This here solves the issue when using pyvista/dreifus in a notebook: Solution