Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

COLMAP sfm needs to be converted to NDC #31

Open
PotatoPalooza opened this issue Aug 10, 2022 · 2 comments
Open

COLMAP sfm needs to be converted to NDC #31

PotatoPalooza opened this issue Aug 10, 2022 · 2 comments

Comments

@PotatoPalooza
Copy link
Member

TensoRF traces rays through a finite bounding box to render views of each scene. Because of this the arbitrary basis for the coordinate system, COLMAP often places cameras too far outside of this bounding box to create accurate reconstruction of the scene. To combat this we must convert the current camera coordinates to Normal Device Coordinates, a standard often used in game engines and 3D rendering that normalizes camera transformations to remain within a unit cube. Conversions scripts for our current sfm data must be created for the MVP

@PotatoPalooza
Copy link
Member Author

Upon further investigation it seems that this conversion is analogous to converting from OpenCV camera coordinate conventions to OpenGL's standards. The following article provides some insight into the differences between the standards. https://amytabb.com/tips/tutorials/2019/06/28/OpenCV-to-OpenGL-tutorial-essentials/.
COLMAP follows the OpenCV convention while TensoRF follows the OpenGL NDC convention. This should help inform how to build the conversion script

@PotatoPalooza
Copy link
Member Author

Partially fixed in PR #33

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant