Skip to content
This repository has been archived by the owner on Nov 14, 2023. It is now read-only.

Evaluate butteraugli on TID-2013 and publish results #40

Open
sp-1234 opened this issue Dec 4, 2017 · 2 comments
Open

Evaluate butteraugli on TID-2013 and publish results #40

sp-1234 opened this issue Dec 4, 2017 · 2 comments

Comments

@sp-1234
Copy link

sp-1234 commented Dec 4, 2017

http://www.ponomarenko.info/tid2013.htm
Metrics are ranked by their Spearman correlation with Mean Opinion Score.

Someone who has hardware powerful enough to make it practical could do this. It would be a real proof (or maybe disproof) that this metric is superior to others.

@kornelski
Copy link

kornelski commented Dec 4, 2017

I've done that with an earlier version of the library #15

For butteraugli this benchmark is problematic, because it also includes heavily distorted images, and butteraugli claims to only support comparison of very similar images.

@sp-1234
Copy link
Author

sp-1234 commented Dec 4, 2017

oops, I somehow overlooked that…

maybe it could make sense to exclude images which are too dissimilar, and look at the correlation for "good" images.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants