Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3D NME #19

Open
reshow opened this issue Sep 20, 2019 · 4 comments
Open

3D NME #19

reshow opened this issue Sep 20, 2019 · 4 comments

Comments

@reshow
Copy link

reshow commented Sep 20, 2019

Hello,thanks for your open source code!
I'm getting start to follow the work of PRN, but I cannot really reimplement their work yet.
I've read your paper on arxiv and noticed that you compared 2DASL with PRN in experiment part.
So I hope you can help me with some problems about the NME metrics.

Do reimplement PRN and get the results or you just evaluate their model?
How do you calculate 3D NME and do you have any idea about how do PRN calculate 3D NME?

(I evaluated the model provided in their github on AFLW2000-3D.
The 2D NME is alright.
But I come up with some problem when calculating 3D NME.

I use exactly the same normalization factor (bounding box size) and calculate the mean L2 distance between ground truth and predicted results.
But the 68 kpt 3D NME I got is around 6.0%, which is much higher than PRN paper's 4.4% and similar to 6.12% in your paper.

I've tried to refer to the evaluation code of 3DDFA but it seems that they didn't evaluate 3D coordinates.)

@Jiaozrr
Copy link

Jiaozrr commented Sep 23, 2019

Puzzled to 3d NME, too. I cannot find an explicit statement...

@reshow
Copy link
Author

reshow commented Sep 23, 2019

Puzzled to 3d NME, too. I cannot find an explicit statement...

The paper of 3D-FAN gives a formula of NME.
I just cannot get the same 3D results of PRN based on this formula. T.T

@Jiaozrr
Copy link

Jiaozrr commented Sep 23, 2019

Puzzled to 3d NME, too. I cannot find an explicit statement...

The paper of 3D-FAN gives a formula of NME.
I just cannot get the same 3D results of PRN based on this formula. T.T

Thx!

@lxzkeyan
Copy link

lxzkeyan commented Dec 5, 2019

Puzzled to 3d NME, too. I cannot find an explicit statement...

The paper of 3D-FAN gives a formula of NME.
I just cannot get the same 3D results of PRN based on this formula. T.T

How to test 3D reconstruction?Can you share the NME code for testing aflw-2000?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants