Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

panorama warping #6

Open
yaodao-x opened this issue Jun 30, 2021 · 10 comments
Open

panorama warping #6

yaodao-x opened this issue Jun 30, 2021 · 10 comments

Comments

@yaodao-x
Copy link

yaodao-x commented Jun 30, 2021

Hi, fnzhan:
It is mentioned in the article, when extracting crops from panorama,you apply the same image warping as in [1] to each image.
There is no open source code of [1], do you implement this method by yourself or ask the author for source code. Or you don't apply this method while training the network.
Best wishes.
[1]Learning to predict indoor illumination from a single image. In: SIGGRAPH Asia (2017)

@fnzhan
Copy link
Owner

fnzhan commented Jun 30, 2021

The warping operation is quite trivial, we try to implement it but give up soon. Later, we directly obtained the warped image from author of [1].

@yaodao-x
Copy link
Author

OMG,you reply very quickly. Thanks a lot.

@cyjouc
Copy link

cyjouc commented Jul 2, 2021

Hi, fnzhan:
would like share the method how to choose the best regression training model?the train.py script have not the model.val?
could you like guide the process?
best wishes!

@fnzhan
Copy link
Owner

fnzhan commented Jul 2, 2021

You can divide a validation set, and compute the L1 distance between the gaussian maps reconstructed by predicted parameters and gt parameters as the validation accuracy. Then the best regression model can be selected.

@cyjouc
Copy link

cyjouc commented Jul 2, 2021

TKS very much for your helpNow,I have some problems?Please guide me!
1、train.py script produce the summary.jpg,the left is original image,Is the right predicted map? the right image is generated by the code(env_gt_pred = np.vstack((env_gt, env_pred)) ), can I understand the env_gt is gt parameters and env_pred is the predicted parameters?
However,from the predicted output image results, it feels that the predicted features are not quite right?
2、Do the angular error added the traing processing for the quantitative evaluation? would you like share the part of the code?

@fnzhan
Copy link
Owner

fnzhan commented Jul 2, 2021

TKS very much for your helpNow,I have some problems?Please guide me!
1、train.py script produce the summary.jpg,the left is original image,Is the right predicted map? the right image is generated by the code(env_gt_pred = np.vstack((env_gt, env_pred)) ), can I understand the env_gt is gt parameters and env_pred is the predicted parameters?
However,from the predicted output image results, it feels that the predicted features are not quite right?
2、Do the angular error added the traing processing for the quantitative evaluation? would you like share the part of the code?

  1. The training process may not be successful, you can try to over-fit the model over a small set at first.
  2. The angular error is not added to the training process. angular error can be found in this paper 'DeepLight: Learning Illumination for Unconstrained Mobile Mixed Reality'.

@cyjouc
Copy link

cyjouc commented Jul 2, 2021

help me quantitate the result?
1

@cyjouc
Copy link

cyjouc commented Jul 5, 2021

Hi, fnzhan:
the trained datas of the geprojector also divided as the same of regression process?

@fnzhan
Copy link
Owner

fnzhan commented Dec 3, 2021

help me quantitate the result? 1

Here are some expected training results:
93_0
93_1500

93_2100

@fnzhan
Copy link
Owner

fnzhan commented Dec 3, 2021

Hi, fnzhan: the trained datas of the geprojector also divided as the same of regression process?

Sorry for the late reply, there is too many things and deadlines. Definitely, the same dataset division for regression and generation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants