Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add point queries and clean up GetMasks2D message. #24

Merged
merged 1 commit into from
Dec 22, 2023
Merged

Conversation

uavster
Copy link
Contributor

@uavster uavster commented Dec 22, 2023

This PR adds point queries to the segmentation action goal. This is compatible with the interface of the upcoming Superseg model. Other segmentation action servers should also enforce that only masks containing at least one point are returned.

@uavster uavster requested a review from sea-bass December 22, 2023 12:15
Copy link
Contributor

@sea-bass sea-bass left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we also want bounding boxes added?

@uavster
Copy link
Contributor Author

uavster commented Dec 22, 2023

Do we also want bounding boxes added?

Exposing an API with points and boxes would involve some extra effort right now. SAM only allows one bounding box and therefore can't do negative boxes. Also, that sole box might not play well together with points. There are some threads about issues with that and Meta's demo only lets you use either one, not in combination. So, I'm deferring box queries until we see if multi-point queries do not give us what box queries would.

@uavster uavster merged commit 3e0cec8 into main Dec 22, 2023
2 checks passed
@uavster uavster deleted the point-filter branch December 22, 2023 12:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants