Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Differences in validation metrics #198

Open
zhang-haojie opened this issue Sep 26, 2024 · 3 comments
Open

Differences in validation metrics #198

zhang-haojie opened this issue Sep 26, 2024 · 3 comments

Comments

@zhang-haojie
Copy link

I noticed that your validation metric on the HDTF dataset is 173, whereas another work EchoMimic your results shows a metric of 501. I would like to understand the specific details of the validation process. For instance, does ‘90% of the identity data’ refer to 90% of the data for each identity, or is it a random 90% sample across all identities? It also seems that the 188 clips you used from the HDTF dataset are significantly fewer than the total number of clips in the HDTF dataset

@todochenxi
Copy link

image
188 是过滤过的吧

@zhang-haojie
Copy link
Author

zhang-haojie commented Oct 9, 2024

我使用官方的数据处理脚本,过滤之后依然有350多个clips

@todochenxi
Copy link

HDTF的数据是打好标签再分割的吧,我理解的是hallo在HDTF基础上过滤出了188个 。。。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants