Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reconstruct a Mesh with texture using pictures #14

Open
nihao-eng opened this issue Aug 4, 2023 · 2 comments
Open

Reconstruct a Mesh with texture using pictures #14

nihao-eng opened this issue Aug 4, 2023 · 2 comments

Comments

@nihao-eng
Copy link

Hello, may I ask how long it will take to reconstruct the Mesh with texture using the picture?

@Lakonik
Copy link
Owner

Lakonik commented Aug 4, 2023

Hi! Inference time can be found in section B.3. of the paper.

Under the reconstruction setting with the same batch size, a single guided DDIM step or Langevin step takes 0.21 sec, and a single outer finetuning step takes 0.28 sec (when K_in = 4). This sums up to around 23 sec for reconstructing a batch of 8 Cars (single-view), and 102 sec for reconstructing a batch of 8 Chairs (single-view) with additional Langevin steps. Once the triplane latent codes are sampled, neural rendering can be performed in real time to synthesize the output images.

To get textured meshes however, you need additional post-processing code to extract them from the nerfs, which is not supported in this codebase.

@nihao-eng
Copy link
Author

Hi! Inference time can be found in section B.3. of the paper.

Under the reconstruction setting with the same batch size, a single guided DDIM step or Langevin step takes 0.21 sec, and a single outer finetuning step takes 0.28 sec (when K_in = 4). This sums up to around 23 sec for reconstructing a batch of 8 Cars (single-view), and 102 sec for reconstructing a batch of 8 Chairs (single-view) with additional Langevin steps. Once the triplane latent codes are sampled, neural rendering can be performed in real time to synthesize the output images.

To get textured meshes however, you need additional preprocessing code to extract them from the nerfs, which is not supported in this codebase.

Thanks for your reply, I will read your paper carefully and try to extract mesh with texture

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants