Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace Cineast's SkeletonPose descriptor #100

Open
ppanopticon opened this issue Aug 26, 2024 · 0 comments
Open

Replace Cineast's SkeletonPose descriptor #100

ppanopticon opened this issue Aug 26, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@ppanopticon
Copy link
Member

ppanopticon commented Aug 26, 2024

Task Description

In #94 we discussed features that should be ported over from Cineast. One of these features was the SkeletonPose feature that can be used to estimate poses in images and use them for retrieval.

However, the current implementation has several shortcomings:

  • It relies on TensorFlow models that must be bundled with the binary.
  • It relies on some arcana distance function, that can currently not be supported by vitrivr-engine's query execution engine let alone some of the storage engines.

The goal of this issue is therefore to replace the SkeletonPose with the following goals.

  • Use state-of-the-art techniques to estimate and encode skeleton poses in a vector such that this vector can be used for similarity search.
  • Assuming, that such a technique relies on machine learning models, integrate these in tho the feature extraction server or TorchServer (whatever is more suitable).

Dependencies

In light of #19, we ought to check, whether this should be part of the FES infrastructure or TorchServe.

Boundary Conditions

None

@vitrivr vitrivr deleted a comment Aug 26, 2024
@vitrivr vitrivr deleted a comment Aug 26, 2024
@ppanopticon ppanopticon added the enhancement New feature or request label Aug 26, 2024
@ppanopticon ppanopticon added this to the Release Candidate #2 milestone Aug 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants
@ppanopticon and others