Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MM] clip_similarity_filter #59

Closed
HYLcool opened this issue Nov 2, 2023 · 0 comments · Fixed by #69
Closed

[MM] clip_similarity_filter #59

HYLcool opened this issue Nov 2, 2023 · 0 comments · Fixed by #69
Assignees
@zhijianma
Labels
dj:multimodal issues/PRs about multimodal data processing enhancement New feature or request
Milestone
Basic Multimodal ...

Comments

@HYLcool
Copy link
Collaborator

HYLcool commented Nov 2, 2023

A new Filter clip_similarity_filter will be supported. For a multimodal sample that contains images and texts, if the CLIP similarities between image-text pairs are out of a specific range, this sample will be filtered out.
@HYLcool HYLcool added enhancement New feature or request dj:multimodal issues/PRs about multimodal data processing labels Nov 2, 2023
@HYLcool HYLcool added this to the Multimodal Support milestone Nov 2, 2023
@HYLcool HYLcool assigned HYLcool and zhijianma and unassigned HYLcool Nov 10, 2023
@HYLcool HYLcool linked a pull request Nov 14, 2023 that will close this issue
Feature/clip similarity filter #69
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zhijianma zhijianma

Labels
dj:multimodal issues/PRs about multimodal data processing enhancement New feature or request
Projects
None yet
Milestone
Basic Multimodal Support
Development

Successfully merging a pull request may close this issue.

Feature/clip similarity filter modelscope/data-juicer
2 participants
@HYLcool @zhijianma