Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] CLIP and DINO via TorchServe #124

Open
3 tasks
ppanopticon opened this issue Nov 26, 2024 · 0 comments
Open
3 tasks

[FEATURE] CLIP and DINO via TorchServe #124

ppanopticon opened this issue Nov 26, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@ppanopticon
Copy link
Member

ppanopticon commented Nov 26, 2024

Description

With TorchServe integration in place (see #19 and #122), it would be nice to have a CLIP and DINO implementation that could be used via TorchServe. This requires some integration effort on the model side

Solution

Basically, we need implementations of CLIP and DINO features that can be registered via TorchServe and respective adapters on the vitrivr side. The adjusted models could be maintained in a dedicated repository. The following steps are involved:

  • Prepare CLIP model for serving via TorchServe.
  • Prepare DINO model for serving via TorchServe.
  • Add TorchServe implementations to the existing torch serve module. The implementations can inherit from the existing, abstract classes.

Dependencies

Wait for #122 to be merged.

Context

Add any other context or screenshots about the feature request here.

@ppanopticon ppanopticon added the enhancement New feature or request label Nov 26, 2024
@ppanopticon ppanopticon added this to the Release Candidate #2 milestone Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants