Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PicoXR] Do not use XR_FB_hand_tracking_aim #1680

Merged
merged 1 commit into from
Jan 15, 2025
Merged

Conversation

svillar
Copy link
Member

@svillar svillar commented Jan 14, 2025

This vendor extension provides very good values for aim when using hand tracking and is also able to detect some common gestures like pinching or doing a system gesture. It has never been really advertised by the runtime as supported but we knew it worked so we were using it anyway.

However the behaviour in the latest versions of the OpenXR runtime from Pico has degraded a lot, to the point that is no longer able to detect those hand gestures. This means that we could only use the aim at the most. Provided our computed aim is good enough it's better to completely disable the extension for Pico.

A nice side effect, is that the ray now properly originates from the hand. With the extension the ray origin was shifted upwards.

Fixes #1679

This vendor extension provides very good values for aim when using
hand tracking and is also able to detect some common gestures
like pinching or doing a system gesture. It has never been really
advertised by the runtime as supported but we knew it worked so
we were using it anyway.

However the behaviour in the latest versions of the OpenXR runtime
from Pico has degraded a lot, to the point that is no longer able
to detect those hand gestures. This means that we could only use
the aim at the most. Provided our computed aim is good enough
it's better to completely disable the extension for Pico.

A nice side effect, is that the ray now properly originates from
the hand. With the extension the ray origin was shifted upwards.

Fixes #1679
@svillar svillar added the release_candidate PR that should be part of the next release label Jan 14, 2025
@svillar
Copy link
Member Author

svillar commented Jan 14, 2025

Before
before

and after
after

Copy link
Collaborator

@felipeerias felipeerias left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Hand tracking and gesture detection work well without this extension.

@svillar svillar merged commit b5a99e0 into main Jan 15, 2025
22 checks passed
@svillar svillar deleted the pico_fb_hand_tracking_aim branch January 15, 2025 09:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_candidate PR that should be part of the next release
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Pico] Go back gesture with left hand not working
2 participants