Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How did you evaluate the NME of your model and PRNet in 3D face reconstruction? #33

Open
deepdarkfans opened this issue Feb 1, 2021 · 7 comments

Comments

@deepdarkfans
Copy link

PRNet has different dimensions than any other model because the neck part is removed. When I evaluated PRNet and your model, I found that PRNet's has the worst NME, probably because I removed some dimensions from the ground truth, so how did you evaluate the two models?

@Nancyh-e
Copy link

hi, how to get NME of PRNet,i get a bigger result compare to the NME paper. hope your reply!thanks!

@HOMGH
Copy link

HOMGH commented Jul 16, 2021

Hi @deepdarkfans , did you get your answer? I have the same question as we get 43K vertices using PRNet but the groundtruth for AFLW2000 data set has 53K vertices.

@deepdarkfans
Copy link
Author

Hi @deepdarkfans , did you get your answer? I have the same question as we get 43K vertices using PRNet but the groundtruth for AFLW2000 data set has 53K vertices.

No, but I have a method you can try. When calculating NME, you can multiply the ground truth of AFLW2000 by the weight matrix of the PRNet loss function, which should ignore the neck part

@deepdarkfans
Copy link
Author

hi, how to get NME of PRNet,i get a bigger result compare to the NME paper. hope your reply!thanks!

I have a method you can try. When calculating NME, you can multiply the ground truth of AFLW2000 by the weight matrix of the PRNet loss function, which should ignore the neck part

@HOMGH
Copy link

HOMGH commented Jul 20, 2021

Hi @deepdarkfans , did you get your answer? I have the same question as we get 43K vertices using PRNet but the groundtruth for AFLW2000 data set has 53K vertices.

No, but I have a method you can try. When calculating NME, you can multiply the ground truth of AFLW2000 by the weight matrix of the PRNet loss function, which should ignore the neck part

Thank you for your reply. Where can I find this weight matrix? Do you mean the uv_face _mask in ./Data folder? (below)
But this can be multiplied by the uv position map not the vertices. So should we first convert AFLW2000 ground truth to uv position map and then multiply with this map?
image

@deepdarkfans
Copy link
Author

Yes, you need to convert AFLW2000 to UV position map,

@HOMGH
Copy link

HOMGH commented Jul 21, 2021

Yes, you need to convert AFLW2000 to UV position map,

Awesome! Thanks :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants