Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explanation of output shape [1, 117] (World landmarks for pose) or [1, 195] (Pose landmarks) of pose_landmarks_detector.tflite in Mediapipe #5622

Open
mbkamran opened this issue Sep 12, 2024 · 0 comments
Assignees
Labels
platform:python MediaPipe Python issues task:pose landmarker Issues related to Pose Landmarker: Find people and body positions type:support General questions

Comments

@mbkamran
Copy link

I downloaded the pose_landmaker_lite.task file from the official Mediapipe guide for Pose Landmark Detection here:

image

In order to access its .tflite models, I unzipped it using unzip pose_landmaker_lite.task and got 2 files: pose_detector.tflite and pose_landmarks_detector.tflite.

Question 1: How do we interpret these models and how are they being used for tasks?

pose_landmarks_detector.tflite appears to be one for pose detection, as we can visualize the structure and outputs of both the models at Netron App and see that this model has pose detection outputs:

image

However, I have difficulty understanding the shapes and meaning of both "Pose landmarks" Output Shape: [1,195] and "World landmarks for pose" Output Shape: [1,117]

Question 2: How do we interpret the shapes [1,195] and [1,117]?

And finally,

Question 3: How do we interpret the structure of the model, especially that how does it relate with BlazePose and MobileNetV2? Also is there any support for fine-tuning, using the trained backbone in this model and writing a custom head?

@mbkamran mbkamran added the type:others issues not falling in bug, perfromance, support, build and install or feature label Sep 12, 2024
@kuaashish kuaashish assigned kuaashish and unassigned ayushgdev Sep 13, 2024
@kuaashish kuaashish added task:pose landmarker Issues related to Pose Landmarker: Find people and body positions type:support General questions platform:python MediaPipe Python issues and removed type:others issues not falling in bug, perfromance, support, build and install or feature labels Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
platform:python MediaPipe Python issues task:pose landmarker Issues related to Pose Landmarker: Find people and body positions type:support General questions
Projects
None yet
Development

No branches or pull requests

3 participants