Skip to content

Monocular Depth Estimation Toolbox and Benchmark.

License

Notifications You must be signed in to change notification settings

OpenSpaceAI/mmdepth

 
 

Repository files navigation

Monocular Depth Estimation Toolbox and Benchmark
 

docs license Average time to resolve an issue Percentage of issues still open visitors

Introduction

MMDepth is an open source monocular depth estimation toolbox based on PyTorch. The main branch works with PyTorch 1.6+.

Note that this repo is not a part of the OpenMMLab project. It is built on top of MMSegmentation. If there is any infringement please contact ruijiezhu@mail.ustc.edu.cn.

🎉 Introducing mmdepth v1.0.0 🎉

Since this is the first version of this repo, there are inevitably many imperfections. The code library inherits most of the functions and advantages of MMSegmentation, and adds or expands some components. We welcome you to develop and maintain this repo together!

Major features

  • Unified Benchmark

    We provide a unified toolbox and benchmark for training or testing models on multiple depth datasets.

  • Modular Design

    Following OpenMMLab series, we decompose the monocular depth estimation models into different components. As a result, it is easy to construct a customized monocular depth estimation model by combining different modules.

User guides

Please refer to get_started.md for installation and dataset_prepare.md for dataset preparation.

Please refer to train.md for model training and inference.md for model inference.

For detailed guides for development, please see tutorials from MMSegmentation.

Projects

Here are some implementations of SOTA models and solutions built on MMDepth, which are supported and maintained by community users. These projects demonstrate the best practices based on MMDepth for research and product development. We welcome and appreciate all the contributions to these projects. Also, we appreciate all contributions to improve MMDepth framework.

ScaleDepth: Decomposing Metric Depth Estimation into Scale Prediction and Relative Depth Estimation
Ruijie Zhu, Chuxin Wang, Ziyang Song, Li Liu, Tianzhu Zhang, Yongdong Zhang
Arxiv, 2024
[Paper] [Webpage] [Code]
BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimation
Zhenyu Li, Xuyang Wang, Xianming Liu, and Junjun Jiang
IEEE Transactions on Image Processing, 2024
[Paper] [Code]

Benchmark and model zoo

Results and models are available in the model zoo.

Overview
Supported datasets Supported backbones Supported head Supported loss
  • boundary_loss
  • cross_entropy_loss
  • dice_loss
  • focal_loss
  • huasdorff_distance_loss
  • kldiv_loss
  • lovasz_loss
  • ohem_cross_entropy_loss
  • silog_loss
  • tversky_loss
  • Acknowledgement

    MMDepth is an open source project maintained by the author alone (at least for now). The original intention of building this project is to provide a standardized toolbox and benchmark for monocular depth estimation. We thank the contributers of MMSegmentation for providing a great template for this project. We also thank the authors of Monocular-Depth-Estimation-Toolbox and ZoeDepth, whose code this project borrowed.

    Citation

    If you find this project useful in your research, please consider cite:

    @misc{mmdepth2024,
        title={{mmdepth}: Monocular Depth Estimation Toolbox and Benchmark},
        author={Ruijie Zhu},
        howpublished = {\url{https://github.com/RuijieZhu94/mmdepth}},
        year={2024}
    }

    License

    This project is released under the Apache 2.0 license.

    About

    Monocular Depth Estimation Toolbox and Benchmark.

    Resources

    License

    Stars

    Watchers

    Forks

    Releases

    No releases published

    Packages

    No packages published

    Languages

    • Python 99.9%
    • Shell 0.1%