Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Usage of Depth Maps #88

Open
JesseZZZZZ opened this issue Dec 3, 2024 · 6 comments
Open

Usage of Depth Maps #88

JesseZZZZZ opened this issue Dec 3, 2024 · 6 comments

Comments

@JesseZZZZZ
Copy link

Hi, dear authors!
Thank you for your great work, I have a small issue. In your paper, the depth information is part of the patch. But during inference, the depth maps are initialized all zero, how can this be? Is this because depth is only related to optical flow loss, and not related to trajectory loss, so you don't need depth maps during inference?

Thank you!

@lushouyi
Copy link

lushouyi commented Dec 3, 2024

The author did not use the ground truth depth information during the training process. Instead, the depth values were set to random numbers.

@JesseZZZZZ
Copy link
Author

JesseZZZZZ commented Dec 3, 2024

@lushouyi Are you sure...? I believe the disps is the inverse depth... Only the depth map durence inference is initialized all zeros
image

@lushouyi
Copy link

lushouyi commented Dec 3, 2024

Line 206 of the net.py file

@JesseZZZZZ
Copy link
Author

JesseZZZZZ commented Dec 3, 2024 via email

@JesseZZZZZ
Copy link
Author

@lushouyi Well, I don't understand every line of code, but I think the depth map is used somewhere, because NAN appears when I change the depth maps to all zeros

@lushouyi
Copy link

lushouyi commented Dec 5, 2024

You can set everything to 1 instead, I feel that setting everything to 0 might be problematic.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants