Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About training data process #28

Open
cyf23 opened this issue Oct 9, 2024 · 2 comments
Open

About training data process #28

cyf23 opened this issue Oct 9, 2024 · 2 comments

Comments

@cyf23
Copy link

cyf23 commented Oct 9, 2024

Hi,

Thank you for your outstanding work! I have a question regarding the training process. When generating the conditioning signal, I understand that the point cloud is obtained from a single frame. However, during rendering, is the camera pose derived from running dust3r on a single frame, or from a clip of 25 frames? If it's the latter, could there be any discrepancies between the pose predicted from 25 frames during rendering and the one predicted from a single frame during inference?

Thank you for your help and for the excellent work you’ve done!

@Drexubery
Copy link
Owner

Thanks for your interest!

During training, the camera poses are derived from all 25 frames. During inference, the reference camera pose is not predicted; instead, it is fixed at (r, 0, 0) in the world coordinate system, and the subsequent camera poses are specified by the users, so there should be no discrepancies.

@HMZ76
Copy link

HMZ76 commented Jan 13, 2025

Thank you for your outstanding work! Could you please offer me the process training data code ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants