Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Localization criteria for object instances and association to ground truth objects #43

Open
csudre opened this issue May 30, 2022 · 0 comments

Comments

@csudre
Copy link
Collaborator

csudre commented May 30, 2022

Is your feature request related to a problem? Please describe.
In order to define some instance segmentation related metrics such as panoptic quality, one needs to be able to identify true positive instances and their corresponding ground truth. The first step in that pipeline is to define localisation criteria followed by an association strategy

Describe the solution you'd like
Implementation of the different localization criteria resulting for each element in a list of possible reference instances.

  • Boundary IoU
  • Mask IoU
  • Box IoU (already implemented)
  • Distance based criteria of centre of mass (must be lower than a threshold)
  • Centre based criteria (if centre of reference is included in prediction)

The hit criteria output is then followed by an association step:

  • Greedy based on score - The prediction instances are ranked by prediction score and assigned (if possible according to the hit criterion) to a single ground truth (the one with the best score). The reference associated object is then removed from the list of possible objects
  • Hungarian algorithm - Association based on minimisation of overall hit score

Need optional consideration of multiple instances hitting a given reference instances either removing them from the validation or considering them as FP

@vikashg vikashg transferred this issue from Project-MONAI/MONAI Jan 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant