Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to get 3D pose under a global coordinate? #41

Open
Steve-Tod opened this issue Jan 7, 2024 · 3 comments
Open

Is it possible to get 3D pose under a global coordinate? #41

Steve-Tod opened this issue Jan 7, 2024 · 3 comments

Comments

@Steve-Tod
Copy link

Currently, the reconstruction is done on the image patch of the detected human bounding box. I tried directly rendering the reconstructed poses of a video with fixed camera parameters, but the result kept jittering. Is there an easy way to transfer from the predicted local 3D pose (with respect to the image patch) to a global 3D pose based on the bounding box parameters?

@Wei-Chen-hub
Copy link
Collaborator

Actually our SMPLERX model is trained by camera space data, which is not good at world coord consistency.

As for your concern, please checkout SMPLERX output, the estimated intrinsics could be varing. So i suggest you to use "SMPLX translation / focal length" to get a "real" 3D translation, then smooth it. Please checkout if that helps.

@Zhanglh8559
Copy link

Thank you for your exciting job. For my current work, I need the information about camera extrinsics. Since the intrinsics can be varing in this way, is there any way that I can get the camera extrinsics?

@Wei-Chen-hub
Copy link
Collaborator

Thank you for your exciting job. For my current work, I need the information about camera extrinsics. Since the intrinsics can be varing in this way, is there any way that I can get the camera extrinsics?

Our smplerx only focus on camera space pose estimation, for global information (extrinsics), please see our newest work WHAC: World-grounded Humans and Cameras

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants