Some problems encountered in preparing data

[ZYCheng777]

Hi!
I follow the README to prepare DDAD data. But after I perform sift and match operations, I find that the content contained in the sift and match folders is not complete. There should be folders from 000 to 199, but the sift and match folders are not complete, my sift folder only contains 000 to 106, and my match folder only contains 001 to 144. The same problem also exists in the depth folder, the numbered files in this folder are complete (000 to 199), but some files are empty. Why are these situations?

[weiyithu]

Hi, have you ever seen any error message? For depth, we directly use dgp codebase to generate groundtruth depth and we think there should not exist bugs. Have you check that whether downloaded RGB images are complete?

[ZYCheng777]

Hi!
I checked the integrity of the downloaded DDAD dataset and re-prepare the data, but the problem is not resolved. When I run sift_ddad.py only the following content appears, then the run stops automatically, and the generated folder is empty.

The content in my sift environment is like this

[weiyithu]

Hi，does the depth folder also have this problem?

[ZYCheng777]

The depth folder number is complete(000-199),but there are no npy files in some folders(000-143).

[weiyithu]

Oh, for depth we only generate validation set, so 000-149 should be empty. However, for sift, we generate train set, and there should be 100-149 folders. You can delete multi-processing in sift_ddad.py and see whether there is a bug. Here is my wechat 18600500891, you can feel free to contact me.

[chinmay1148]

Facing a similar issue. There are 200 scenes in ddad.
Had no issue with $ python export_gt_depth_ddad.py val
But $python sift_ddad.py is only generating sift data for 139 scene.
And $ python match_ddad.py is generating it for 110 scenes only.
Because of which the unable to train ddad_sfm_pretraining step.

How to generate data using sift_ddad.py and match_ddad.py ?

[weiyithu]

We use multiprocessing when generating sift data

SurroundDepth/tools/sift_ddad.py

Line 59 in 0156aef

p = multiprocessing.Pool(8)

and it my not report bug. You can close the multiprocessing and see where the bug is.