Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hand Rotation problem #52

Open
liudongdong1 opened this issue Mar 12, 2024 · 7 comments
Open

Hand Rotation problem #52

liudongdong1 opened this issue Mar 12, 2024 · 7 comments

Comments

@liudongdong1
Copy link

Hi, thanks for your great work again.
I am utilizing the SMPL-X-H32 model to process an online video featuring extensive hand movements. When attempting to transform the model's hand rotation output into BVH motion files, I've observed that the resulting hand rotations are less than ideal. Despite adjusting the orientations, which improved some frames, inconsistencies persist in the hand orientations across others.

question 1. The degree of finger bending is too slight, and for some frame, the direction of finger bending seems wrong;
image
image
question 2. i modify the direction of the above frame, it seems ok, but other frames seem wrong;
image
image
question3. The facial parameters seem not taken effect.
`class FaceRegressor(nn.Module):
def init(self, feat_dim=768):
super(FaceRegressor, self).init()
self.expr_out = make_linear_layers([feat_dim, smpl_x.expr_code_dim], relu_final=False)
self.jaw_pose_out = make_linear_layers([feat_dim, 6], relu_final=False)

def forward(self, expr_token, jaw_pose_token):
    expr_param = self.expr_out(expr_token)  # expression parameter
    jaw_pose = self.jaw_pose_out(jaw_pose_token)  # jaw pose parameter
    return expr_param, jaw_pose`
@zxx123518
Copy link

Hello, I am also studying hand Rotation problem at present, could you share the code related to your movement output? Thank you very much!

@WingkitChou
Copy link

model hand's initial pose is different, use relaxing hand instead.

@Wei-Chen-hub
Copy link
Collaborator

Hi, the problem seems related to flat_hand_mean, smplerx assumes 'flat_hand_mean'=False. Please check this kwarg when creating the smplx model.

@TDIT-haha
Copy link

I want to know if this problem was solved later? What is the reason?

@TDIT-haha
Copy link

@iamthephd
Copy link

@sonukiller
Copy link

I want to know if this problem was solved later? What is the reason?

Yes, I was able to solve the problem using flat_hand_mean=False in kwarg while creating SMPLX model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants