Skip to content

mattpoggi/pydnet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PyDNet & PyDNet2

Update:

If you are looking Android/iOS implementations of PyDnet, take a look here: https://github.com/FilippoAleotti/mobilePydnet

Update v2:

Demo code for PyDNet2 has been included!

This repository contains the source code of PyDNet, proposed in the paper "Towards real-time unsupervised monocular depth estimation on CPU", IROS 2018, and PyDNet2, proposed in the paper "Real-Time Self-Supervised Monocular Depth Estimation Without GPU", T-ITS. If you use this code in your projects, please cite our paper:

PyD-Net:

@inproceedings{pydnet18,
  title     = {Towards real-time unsupervised monocular depth estimation on CPU},
  author    = {Poggi, Matteo and
               Aleotti, Filippo and
               Tosi, Fabio and
               Mattoccia, Stefano},
  booktitle = {IEEE/JRS Conference on Intelligent Robots and Systems (IROS)},
  year = {2018}
}

PyD-Net2:

@article{poggi2022realtime,
  title={Real-time Self-Supervised Monocular Depth Estimation Without GPU},
  author={Poggi, Matteo and Tosi, Fabio and Aleotti, Filippo and Mattoccia, Stefano},
  journal={IEEE Transactions on Intelligent Transportation Systems},
  year={2022},
}

For more details:

PyDNet (arXiv)

PyDNet2 (IEEExplore)

Demo video:

PyDNet

PyDNet2

Requirements

  • Tensorflow 1.8 (recommended)
  • python packages such as opencv, matplotlib

Run pydnet on webcam stream

To run PyDNet or PyDNet2, just launch

python webcam.py --model [pydnet,pydnet2] --resolution [1,2,3]

Train pydnet from scratch

Requirements

  • monodepth (https://github.com/mrharicot/monodepth) framework by Clément Godard

After you have cloned the monodepth repository, add to it the scripts contained in training_code folder from this repository (you have to replace the original monodepth_model.py script). Then you can train pydnet inside monodepth framework.

Evaluate pydnet on Eigen split

To get results on the Eigen split, just run

python experiments.py --datapath PATH_TO_KITTI --filenames PATH_TO_FILELIST --checkpoint_dir checkpoint/IROS18/pydnet --resolution [1,2,3]

This script generates disparity.npy, that can be evaluated using the evaluation tools by Clément Godard

About

Repository for pydnet, IROS 2018

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages