Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

想获取一下SIMSv2这个数据集的特征提取的配置 #31

Open
tangyc314 opened this issue Oct 31, 2023 · 2 comments
Open

想获取一下SIMSv2这个数据集的特征提取的配置 #31

tangyc314 opened this issue Oct 31, 2023 · 2 comments

Comments

@tangyc314
Copy link

"audio": {
"tool": "opensmile",
"sample_rate": 16000,
"args": {
"feature_set": "eGeMAPSv02",
"feature_level": "LowLevelDescriptors",
"start": null,
"end": null
}
},
"video": {
"tool": "openface",
"fps": 25,
"multiFace": {
"enable": false,
"device": "cuda:0",
"facedetScale": 0.25,
"minTrack": 10,
"numFailedDet": 10,
"minFaceSize": 1,
"cropScale": 0.4
},
"average_over": 1,
"args": {
"hogalign": false,
"simalign": false,
"nobadaligned": false,
"landmark_2D": true,
"landmark_3D": false,
"pdmparams": false,
"head_pose": false,
"action_units": true,
"gaze": false,
"tracked": false
}
以以上参数提取特征,获得的vision特征向量范围不是-1到1,而是会包含一些很大的数据如5.18e+02,是有哪里需要调整吗

@tangyc314
Copy link
Author

按照最终的维度推断,"head_pose"应该是true,但是想知道是怎样归一化的,我直接按行归一化后,模型训练的结果远没有用
simsv2数据集提供的特征结果好

@moom2572
Copy link

请问你解决了吗?我看作者提供的论文里面视觉特征提取先用了talknet又用了openface这是怎么实现的啊

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants