Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement score normalization technique as a post-processor #589

Open
AlekseySh opened this issue Jun 10, 2024 · 0 comments
Open

Implement score normalization technique as a post-processor #589

AlekseySh opened this issue Jun 10, 2024 · 0 comments

Comments

@AlekseySh
Copy link
Contributor

AlekseySh commented Jun 10, 2024

The method is described here. The class has to be child of IRetrievalPostprocessor, take RetrievalResults as input, modify it, and return as a new instance of RetrievalResults class.

The plan is to implement the method and check if it boosts metrics on our real benchmarks (see existing datasets in Pipelines).

Unfortunately, our current metrics are not sensitive to the type of transformation performed by score normalization.
Thus, this issue of adding the appropriate sensitive metric has to be completed first.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: To do
Development

No branches or pull requests

1 participant