Skip to content

Latest commit

 

History

History
 
 

person-detection

readme.md

Person Detection

Models that are able to detect persons.

Model Name Complexity (GFLOPs) Size (Mp) AP @ [IoU=0.50:0.95] (%) Links GPU_NUM
person-detection-0200 0.82 1.83 24.4 snapshot, configuration file 2
person-detection-0201 1.84 1.83 29.9 snapshot, configuration file 4
person-detection-0202 3.28 1.83 32.8 snapshot, configuration file 2

Training pipeline

0. Change a directory in your terminal to object_detection.

cd <openvino_training_extensions>/pytorch_toolkit/object_detection

1. Select a training configuration file and get pre-trained snapshot if available. Please see the table above.

export MODEL_NAME=person-detection-0200
export CONFIGURATION_FILE=./person-detection/$MODEL_NAME/config.py

2. Collect dataset

Collect or download images with persons presented on them.

3. Prepare annotation

Annotate dataset and save annotation to MSCOCO format with person as the only one class.

4. Training and Fine-tuning

Try both following variants and select the best one:

  • Training from scratch or pre-trained weights. Only if you have a lot of data, let's say tens of thousands or even more images. This variant assumes long training process starting from big values of learning rate and eventually decreasing it according to a training schedule.
  • Fine-tuning from pre-trained weights. If the dataset is not big enough, then the model tends to overfit quickly, forgetting about the data that was used for pre-training and reducing the generalization ability of the final model. Hence, small starting learning rate and short training schedule are recommended.

If you would like to start training from pre-trained weights do not forget to modify load_from path inside configuration file.

If you would like to start fine-tuning from pre-trained weights do not forget to modify resume_from path inside configuration file as well as increase total_epochs. Otherwise training will be ended immideately.

  • To train the detector on a single GPU, run in your terminal:

    python ../../external/mmdetection/tools/train.py \
         $CONFIGURATION_FILE

  • To train the detector on multiple GPUs, run in your terminal:

    ../../external/mmdetection/tools/dist_train.sh \
         $CONFIGURATION_FILE \
         <GPU_NUM>

  • To train the detector on multiple GPUs and to perform quality metrics estimation as soon as training is finished, run in your terminal

    python person-detection/tools/train_and_eval.py \
         $CONFIGURATION_FILE \
         <GPU_NUM>

5. Validation

  • To dump detection of your model as well as compute MS-COCO metrics run:

    python ../../external/mmdetection/tools/test.py \
         $CONFIGURATION_FILE \
         <CHECKPOINT> \
         --out result.pkl \
         --eval bbox

6. Export PyTorch* model to the OpenVINO™ format

To convert PyTorch* model to the OpenVINO™ IR format run the export.py script:

python ../../external/mmdetection/tools/export.py \
      $CONFIGURATION_FILE \
      <CHECKPOINT> \
      <EXPORT_FOLDER> \
      openvino

This produces model $MODEL_NAME.xml and weights $MODEL_NAME.bin in single-precision floating-point format (FP32). The obtained model expects normalized image in planar BGR format.

For SSD networks an alternative OpenVINO™ representation is possible. To opt for it use extra --alt_ssd_export key to the export.py script. SSD model exported in such way will produce a bit different results (non-significant in most cases), but it also might be faster than the default one. As a rule SSD models in Open Model Zoo are exported using this option.

7. Validation of IR

Instead of running test.py you need to run test_exported.py and then repeat steps listed in Validation paragraph.

python ../../external/mmdetection/tools/test_exported.py  \
      $CONFIGURATION_FILE \
      <EXPORT_FOLDER>/$MODEL_NAME.xml \
      --out results.pkl \
      --eval bbox

8. Demo

To see how the converted model works using OpenVINO you need to run test_exported.py with --show option.

python ../../external/mmdetection/tools/test_exported.py  \
      $CONFIGURATION_FILE \
      <EXPORT_FOLDER>/$MODEL_NAME.xml \
      --show

Other

Theoretical computational complexity estimation

To get per-layer computational complexity estimations, run the following command:

python ../../external/mmdetection/tools/get_flops.py \
       $CONFIGURATION_FILE