Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(image_projection_based_fusion): resize sematic segmentation mask as input image size #7635

Conversation

badai-nguyen
Copy link
Contributor

@badai-nguyen badai-nguyen commented Jun 24, 2024

Description

Tests performed

Not applicable.

Effects on system behavior

Not applicable.

Interface changes

Pre-review checklist for the PR author

The PR author must check the checkboxes below when creating the PR.

In-review checklist for the PR reviewers

The PR reviewers must check the checkboxes below before approval.

Post-review checklist for the PR author

The PR author must check the checkboxes below before merging.

  • There are no open discussions or they are tracked via tickets.

After all checkboxes are checked, anyone who has write access can merge the PR.

…as input image size

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
@github-actions github-actions bot added the component:perception Advanced sensor data processing and environment understanding. (auto-assigned) label Jun 24, 2024
@badai-nguyen badai-nguyen requested review from manato and dan-dnn June 24, 2024 02:01
@badai-nguyen badai-nguyen marked this pull request as ready for review June 24, 2024 02:23
@badai-nguyen badai-nguyen added the run:build-and-test-differential Mark to enable build-and-test-differential workflow. (used-by-ci) label Jun 24, 2024
Copy link

codecov bot commented Jun 24, 2024

Codecov Report

Attention: Patch coverage is 0% with 3 lines in your changes missing coverage. Please review.

Project coverage is 2.77%. Comparing base (3d849e9) to head (d322b38).
Report is 534 commits behind head on main.

Files Patch % Lines
...fusion/src/segmentation_pointcloud_fusion/node.cpp 0.00% 3 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #7635       +/-   ##
==========================================
- Coverage   15.09%   2.77%   -12.33%     
==========================================
  Files        1967     161     -1806     
  Lines      135941    9630   -126311     
  Branches    42122    1585    -40537     
==========================================
- Hits        20520     267    -20253     
+ Misses      92700    9307    -83393     
+ Partials    22721      56    -22665     
Flag Coverage Δ
differential 2.77% <0.00%> (?)
total ?

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

@YoshiRi YoshiRi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link

Thank you for contributing to the Autoware project!

🚧 If your pull request is in progress, switch it to draft mode.

Please ensure:

@badai-nguyen badai-nguyen merged commit a1b1ec7 into autowarefoundation:main Jun 28, 2024
27 of 30 checks passed
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Jul 2, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
mitukou1109 pushed a commit to mitukou1109/autoware.universe that referenced this pull request Jul 2, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
palas21 pushed a commit to palas21/autoware.universe that referenced this pull request Jul 12, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
Signed-off-by: palas21 <palas21@itu.edu.tr>
tby-udel pushed a commit to tby-udel/autoware.universe that referenced this pull request Jul 14, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
KhalilSelyan pushed a commit that referenced this pull request Jul 22, 2024
…as input image size (#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Aug 1, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Aug 5, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Aug 26, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Sep 2, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Sep 2, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Sep 2, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Sep 2, 2024
…as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
badai-nguyen added a commit to tier4/autoware.universe that referenced this pull request Sep 10, 2024
….29.0 (#1526)

* feat(tensorrt yolox): inference and publish mask image from yolox model with semantic segmentation header (autowarefoundation#5553)

* add segmentation model

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

fix: add multitask for segment

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: publish mask

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* feat: publish colorized mask

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: resize yolox mask

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: add memory allocate operations

Signed-off-by: Manato HIRABAYASHI <manato.hirabayashi@tier4.jp>

* refactor: remove underscore for a local variable

Signed-off-by: Manato HIRABAYASHI <manato.hirabayashi@tier4.jp>

* chore: add condition to check the number of subscriber for newly added topics

Signed-off-by: Manato HIRABAYASHI <manato.hirabayashi@tier4.jp>

* chore: pre-commit

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: add roi overlapping segment

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: roi overlay segment

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: refactor

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* docs: update readme

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: update model name

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: add utils into tensorrt_yolox

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: launch file

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: remove unnecessary depend

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: fix yaml file

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: remove duplicated param in launch

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: semantic class

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* docs: update readme

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: update default param

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: add processing time topic

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: typo

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* style(pre-commit): autofix

* chore: fix cspell error

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: yolox default param

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: rename debug topics

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: rename debug topics

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* docs: update model description

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* style(pre-commit): autofix

* fix: launch

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* refactor: unpublish mask for single task

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* Update perception/tensorrt_yolox/src/tensorrt_yolox.cpp

Co-authored-by: Manato Hirabayashi <3022416+manato@users.noreply.github.com>

* Update perception/tensorrt_yolox/src/tensorrt_yolox.cpp

Co-authored-by: Manato Hirabayashi <3022416+manato@users.noreply.github.com>

* Update perception/tensorrt_yolox/src/tensorrt_yolox.cpp

Co-authored-by: Manato Hirabayashi <3022416+manato@users.noreply.github.com>

* style(pre-commit): autofix

* docs: update reamde

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* style(pre-commit): autofix

* fix: skip mask size as yolox output

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

---------

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
Signed-off-by: Manato HIRABAYASHI <manato.hirabayashi@tier4.jp>
Co-authored-by: Manato HIRABAYASHI <manato.hirabayashi@tier4.jp>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Manato Hirabayashi <3022416+manato@users.noreply.github.com>

* fix(tensorrt_yolox): add run length encoding for sematic segmentation mask (autowarefoundation#7905)

* fix: add rle compress

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: rle compress

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: move rle into utils

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: pre-commit

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* Update perception/autoware_tensorrt_yolox/src/utils.cpp

Co-authored-by: Yukihiro Saito <yukky.saito@gmail.com>

* fix: remove unused variable

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* Update perception/autoware_tensorrt_yolox/src/utils.cpp

Co-authored-by: Manato Hirabayashi <3022416+manato@users.noreply.github.com>

* style(pre-commit): autofix

* feat: add unit test for utils

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* style(pre-commit): autofix

* fix: unit test

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: change to explicit index

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* style(pre-commit): autofix

* fix: cuda cmake

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: separate unit test into different PR

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

---------

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
Co-authored-by: Yukihiro Saito <yukky.saito@gmail.com>
Co-authored-by: Manato Hirabayashi <3022416+manato@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* refactor(tensorrt_yolox): move utils into perception_utils (autowarefoundation#8435)

* chore(tensorrt_yolo): refactor utils

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* style(pre-commit): autofix

* fix: tensorrt_yolox

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

---------

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* fix(perception_utils): install library after build (autowarefoundation#8501)

Signed-off-by: Manato HIRABAYASHI <manato.hirabayashi@tier4.jp>

* fix(image_projection_based_fusion): resize sematic segmentation mask as input image size (autowarefoundation#7635)

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix(image_projection_based_fusion): segmentation pointcloud fusion param update (autowarefoundation#7858)

* fix(image_projection_based_fusion): add run length decoding for segmentation_pointcloud_fusion (autowarefoundation#7909)

* fix: add rle decompress

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* style(pre-commit): autofix

* fix: use rld in tensorrt utils

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: rebase error

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: dependency

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: skip publish debug mask

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* Update perception/autoware_image_projection_based_fusion/src/segmentation_pointcloud_fusion/node.cpp

Co-authored-by: kminoda <44218668+kminoda@users.noreply.github.com>

* style(pre-commit): autofix

* Revert "fix: skip publish debug mask"

This reverts commit 30fa9ae.

---------

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: kminoda <44218668+kminoda@users.noreply.github.com>

* feat(tier4_perception_launch): add image segmentation based pointcloud filter (autowarefoundation#7225)

* feat(tier4_perception_launch): add image segmentation based pointcloud filter

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: typo

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* fix: detection launch

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* chore: add maintainer

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* Revert "chore: add maintainer"

This reverts commit 5adfef6.

---------

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>

* style(pre-commit): autofix

* fix(autoware_image_projection_based_fusion): resolve issue with segmentation pointcloud fusion node failing with multiple mask inputs (autowarefoundation#8769)

---------

Signed-off-by: badai-nguyen <dai.nguyen@tier4.jp>
Signed-off-by: Manato HIRABAYASHI <manato.hirabayashi@tier4.jp>
Co-authored-by: Manato HIRABAYASHI <manato.hirabayashi@tier4.jp>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Manato Hirabayashi <3022416+manato@users.noreply.github.com>
Co-authored-by: Yukihiro Saito <yukky.saito@gmail.com>
Co-authored-by: kminoda <44218668+kminoda@users.noreply.github.com>
Co-authored-by: Yi-Hsiang Fang (Vivid) <146902905+vividf@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:perception Advanced sensor data processing and environment understanding. (auto-assigned) run:build-and-test-differential Mark to enable build-and-test-differential workflow. (used-by-ci)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants