Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reconstructing a dynamic scene with fast movement #71

Open
albb20 opened this issue Apr 15, 2024 · 3 comments
Open

Reconstructing a dynamic scene with fast movement #71

albb20 opened this issue Apr 15, 2024 · 3 comments

Comments

@albb20
Copy link

albb20 commented Apr 15, 2024

Hi,
as the title says, I'm trying to reconstruct a dynamic scene with three views with large movements of a rigid body. At the moment, the rendered mesh shrinks every frame until it disappears totally after 3-4 frames. See screenshot below.
grafik

My idea was that it must has something to do with the predict global move step, since i have large movements between the frames, as shown below. Do you have an idea, how to change the globalmove parameters for such a scene?
grafik

Strangely, the reconstructed models are not even close to the original images. If i put in the coordinates and images to NGP, the shape of the model is fine.

Thanks in advance.

@19reborn
Copy link
Owner

Hi @albb20, for such case, you may need to increase the training epoch for global movement optimization with less learning rate. Also, increase the aabb_scale or decrease the scale may also be helpful.

@albb20
Copy link
Author

albb20 commented Apr 24, 2024

Hi, thanks for your answer. I'm working in the NeuSPP branch at the moment, where i think aabb must be 1. But since i don't need unbounded scenes, switching to main branch should be beneficial for me.
For the current data, i already tried playing around with global movement. The results above were obtained with learning rates 5e-5 and more epochs. I will try further.

@albb20
Copy link
Author

albb20 commented Jun 19, 2024

Another question: Is there a quick way to remove the possibility to deform the mesh between the timesteps, i.e. to allow only for rigid body reconstruction in a dynamic scene?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants