D2HC-RMVSNet

Here is the official repository of our paper "Dense Hybrid Recurrent Multi-view Stereo Net with Dynamic Consistency Checking" (ECCV2020 Spotlight).

How to Use

Requirements

• python 3.6
• Pytorch >= 1.0.0
• CUDA >= 9.0

Install

./conda_install.sh

Training

• Download the preprocessed DTU training data (also available at Baiduyun, code: s2v2), and upzip it as the MVS_TRANING folder.
• Set dtu_data_root to your MVS_TRAINING path in env.sh Create a log folder and a model folder in wherever you like to save the training outputs. Set the log_dir and save_dir in train.sh correspondingly.
• Train: ./train.sh

Testing

• Download our pretrained model.
• Set TEST_DATA_FOLDER.
• Set MODEL_FOLDER to ckpt and model_ckpt_index to checkpoint_list.
• Run ./eval_dtu.sh for DTU, or ./eval_tanks.sh for Tanks and Temples.

Fusion

• Run fusion_dtu.py for DTU, or fusion_tanks.py for Tanks and Temples.

Benchmark results

Results on DTU

Acc.	Comp.	Overall.
0.395	0.378	0.386

D2HC-RMVSNet point cloud results are provided: DTU evaluation point clouds.

Evaluate the point clouds using the DTU evaluation code.

Results on Tanks and Temples

Mean	Family	Francis	Horse	Lighthouse	M60	Panther	Playground	Train
59.20	74.69	56.04	49.42	60.08	59.81	59.61	60.04	53.92

As shown on Tanks and Temples leaderboard.

Results on BlendedMVS

The corresponding point cloud is also provided: BlendedMVS result.

Citation

If you find this project useful for your research, please cite:

@inproceedings{yan2020dense,
  title={Dense Hybrid Recurrent Multi-view Stereo Net with Dynamic Consistency Checking},
  author={Yan, Jianfeng and Wei, Zizhuang and Yi, Hongwei and Ding, Mingyu and Zhang, Runze and Chen, Yisong and Wang, Guoping and Tai, Yu-Wing},
  booktitle={ECCV},
  year={2020}
}