Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hand Tracking not working #1

Open
jetlius opened this issue May 17, 2022 · 9 comments
Open

Hand Tracking not working #1

jetlius opened this issue May 17, 2022 · 9 comments
Assignees

Comments

@jetlius
Copy link

jetlius commented May 17, 2022

Hi,

I tried the demos, both the built example from the website, as well as installing the examples myself with Unity, but the hand tracking is not working in my device (I am using a Samsung S9, which I believe is supported).

Is there anything I may need to activate first? Thank you

@jeffhuang
Copy link
Contributor

Are you using the HelloWorld example? What are you seeing?

@jetlius
Copy link
Author

jetlius commented May 17, 2022

Are you using the HelloWorld example? What are you seeing?

Yes, I tried the HelloWorld example, the Grab and the Chicken, all of them give the same results.

The planes are being detected, the UI works, but my hand/wrist/arm does not have the points that indicate they are being detected, and I cannot grab and interact with the virtual objects.

@jeffhuang
Copy link
Contributor

Can you attach a screenshot? Please make sure your hand is fully in view of the camera

@jetlius
Copy link
Author

jetlius commented May 17, 2022

Can you attach a screenshot? Please make sure your hand is fully in view of the camera

Screenshot_20220517-160138_PortalbleMediaPipe 1
Screenshot_20220517-160125_PortalbleMediaPipe 1

@jeffhuang
Copy link
Contributor

Thank you, we are able to reproduce the issue on a Samsung S9. We're looking into it. Thanks for your patience, and for reporting the issue.

@jeffhuang jeffhuang assigned tutu5110 and unassigned tutu5110 May 23, 2022
@tutu5110
Copy link
Contributor

Hi Jetlius, Thanks for pointing that out! It has to do with a specific shader we use to share the Unity's camera texture with MediaPipe that is not supported by S9/S9+. S10+ support this texture without an issue. I will update the description to reflect this. Thanks again!

@shoukailiang
Copy link

I also encountered this problem in Mi8 and Mi11

@fweidner
Copy link

I have (it seems) the same problem with a Xiaomi 12 Pro but also with a Pixel 4 XL. Downloaded the repo, followed step 1-4, deploy the HelloWorld scene (with the planet). AR is working but hand tracking is not (on both phones). Building and running the app on a Pixel 6a, AR and hand tracking work fine. Log files are attached (logcat output). Can we pinpoint a cause?

For some reason/hunch, I think it is a config/setup issue bc it's supposed to work on a Pixel 4 (according to the documentation) but does not work on a Pixel 4XL. Any hints appreciated and thanks for open sourcing it :)

Xiaomi12Pro-notworking.txt
Pixel6a-working.txt
Pixel4XL-notworking.txt

@jeffhuang
Copy link
Contributor

thanks for investigating, @fweidner

@tutu5110 have you seen the errors in the notworking logs before? It seems especially strange that it doesn't work on the Pixel 4 XL

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants