Object-Detection-Deep-Reinforcement-Learning

COMP 767 Final Project by Manoosh Samiei and Ruofeng Li (2020/04/20)

---

Kaggle.json key file

Since the number of files in folders of VOC 2012 dataset is very large, mounting this dataset from google drive crashes the google colab sessions. Thus, we download dataset directly from Kaggle website when we run the code.

To download dataset from kaggle, you need a kaggle.json key. We provided this key file in the code base. If you like to download your own kaggle key from your account, use below instructions:

• Go to the Kaggle website (www.kaggle.com)

• Register for a Kaggle account (log in to the exsiting account if you already have one)

• Go to "My Account"

• Select "Create New API Token" under the API section to download the kaggle.json file

---

Hierarchical Method

To test models:

• upload the corresponding notebook to google Colab
• connect to google colab GPU
• upload the model to the left folder bar of google colab in the following directory:
• pascal/models_image_zooms
• to manually upload a file in folder, right click on the folder and click upload
• Be careful that the name of the model used in the testing part should be changed to the name of the model (if it is not the same as the uploaded model).
• Upload kaggle json file, using code snippet, to download dataset directly
• run code snippets in the order they are placed, except mounting google drive and training agent code
• run testing agent part

---

To train models:

• connect to google colab GPU
• Upload kaggle json file, using code snippet, to download dataset directly
• run code snippets in the order they are placed
• Mount your google drive to save trained model for each spoch
• run training agent part
• The models will be also saved in colab folder tab, and can be downloaded manually.

---

Dynamic method

• connect to google colab GPU
• upload model to the left folder bar of google colab in pascal folder
• to manually upload a file in folder, right click on the folder and click upload
• Upload kaggle json file, using code snippet, to download dataset directly
• run code snippets in the order they are placed

In some notebooks, the directory of loading model, in test function, might have been changed to google drive directory. To make it compatible with manual upload of models, simply comment out those lines.

To only test a model, you need to comments out calling train_deep_q() function in main function, and directly run the test.

---

Note: It is highly recommended to run the code with GPU since the runtime is around 30mins per epoch for the hierarchical model and around 1hour per epoch for the dynamic model.

---

Test-train split:

In training, we use images listed in objectclass_train.txt file in datatset. For testing we use images listed in objectclass_val.txt file in datatset.

Number of examples for different object categories do not differ significantly. For most classes, there are around 300 images for each class. However, among classes we tested, 'car' class has around 500 images.

Table of results are included in our submitted report.

In this project, we used google colaboratoru gpu to train and test our models.

---

Please cite the following if you used the code and report:

@misc{https://doi.org/10.48550/arxiv.2208.04511,
  doi = {10.48550/ARXIV.2208.04511},
  url = {https://arxiv.org/abs/2208.04511}, 
  author = {Samiei, Manoosh and Li, Ruofeng},
  keywords = {Computer Vision and Pattern Recognition (cs.CV), Artificial Intelligence (cs.AI), FOS: Computer and information sciences, FOS: Computer and information sciences}, 
  title = {Object Detection with Deep Reinforcement Learning},
  publisher = {arXiv}, 
  year = {2022},
  copyright = {Creative Commons Attribution 4.0 International}
}