Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Take absolute IOU value into account #1

Open
menggui1993 opened this issue Dec 20, 2023 · 2 comments
Open

Take absolute IOU value into account #1

menggui1993 opened this issue Dec 20, 2023 · 2 comments

Comments

@menggui1993
Copy link

Hi, thanks for your work. I have a question about the design. SortedAP is calculated as the area under the IOU-AP curve. However, the absolute value of the IOU threshold is not taken into account, only the IOU difference between points is used. So if the AP is the same for a low IOU threshold point and a high IOU threshold point, they will contribute the same to the sortedAP calculation. Intuitively, the higher IOU threshold value should be more important. So maybe when calculating, we can weight the summation by the absolute IOU value?

@looooongChen
Copy link
Owner

Hi @menggui1993 , thank you for your question. Actually, the absolute IOU is considered. A higher object IOU will lead to a decrease in the AP curve at a higher IOU value, so the area under the curve will be larger than the case of a lower object IOU. You can refer to Figure 2b in the paper, in which we both have 3 predictions but with different IOUs.

1 similar comment
@looooongChen
Copy link
Owner

Hi @menggui1993 , thank you for your question. Actually, the absolute IOU is considered. A higher object IOU will lead to a decrease in the AP curve at a higher IOU value, so the area under the curve will be larger than the case of a lower object IOU. You can refer to Figure 2b in the paper, in which we both have 3 predictions but with different IOUs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants