Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom Object Detection #1

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

Conversation

ugackMiner53
Copy link

An attempt to get Yolo to play nicely with the ZED ROS Wrapper in order to publish custom 3d bounding boxes.

  • Import Yolo, OpenCV, and TensorRT
  • Add custom detection code
  • Disable custom detection if not wanted
  • Add more robust engine file config

A large amount of code and files are taken from this ZED example of Yolo with custom bounding boxes.

Build Instructions
Make sure you have TensorRT and OpenCV installed on your system, as well as the normal requirements of the ZED SDK (now version 4+) and Cuda 12. Once you have all the requirements, run colcon build in a ROS2 workspace!

**IT COMPILES**
- Added Yolo, OpenCV, TensorRT (nvinfer) to cmakelists
- Added lib files from https://github.com/stereolabs/zed-sdk/tree/master/object%20detection/custom%20detector/cpp/tensorrt_yolov5-v6-v8_onnx
- Added Yolo detection to main file
- Disabled all other detectors in `zed_camera_component.hpp`
- Removed two Fusion Position Tracking lines that caused for it to not compile (even without changes)
…m model

- Added custom_model_path to yaml file
- Only do custom box objects if the model type is custom box objects
- Patch the loader function to allow CUSTOM_BOX_OBJECTS as a type
- Remove object filtering if CUSTOM_BOX_OBJECTS is selected
- Better formatting and variable naming
- Less strange debug messages
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant