Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about rendering results of trained model. #6

Open
Kim-GeonU opened this issue Jun 8, 2024 · 5 comments
Open

Question about rendering results of trained model. #6

Kim-GeonU opened this issue Jun 8, 2024 · 5 comments

Comments

@Kim-GeonU
Copy link

Kim-GeonU commented Jun 8, 2024

Thank you for your great work and open-sourcing your code for the community.

I tried training the sequence 114 in the Waymo open dataset by following your instructions, but the trained results seem to have problems.

image

Above results are saved using following code, which just saves images from render_results in do_evaluation() function. I used 30,000 iterations model.

스크린샷 2024-06-08 오후 10 15 48

And I didn't change any other code except above visualization code.

The above rendering results seem to fail to render dynamic objects and also fail to distinguish between static and dynamic objects. Do you have any idea what causes this problem?

image

These are logs during training.

Thank you!

@XuHu0529
Copy link

I have the same results. It seems to fail to reconstruct the dynamic objects.

@tapowanliwuyun
Copy link

Thank you for your great work and open-sourcing your code for the community. I have the same results.
Does this mean that the configuration parameters downloaded need to be modified in order to achieve the desired results?

@nnanhuang
Copy link
Owner

Thank you for your great work and open-sourcing your code for the community.

I tried training the sequence 114 in the Waymo open dataset by following your instructions, but the trained results seem to have problems.

image Above results are saved using following code, which just saves images from render_results in do_evaluation() function. I used 30,000 iterations model. 스크린샷 2024-06-08 오후 10 15 48 And I didn't change any other code except above visualization code.

The above rendering results seem to fail to render dynamic objects and also fail to distinguish between static and dynamic objects. Do you have any idea what causes this problem?

image These are logs during training.

Thank you!

Hello! This sequence does not appear in the two main subsets we use, static32 and dynamic32, and our experimental data in the paper align with both emernerf and street gaussian standards. As such, we have not previously encountered this issue. You might consider experimenting with different parameters, for example, reducing the number of training frames. We will investigate this further and study this particular scenario more closely. Thank you for your interest!

@nevergone123
Copy link

I got the similar bad results using scene 754, which is included in the dynamic 32 splits.
Below is the dynamic_rgb:
image

Do you have any idea to fix it? Many thanks! @nnanhuang

@Kim-GeonU
Copy link
Author

I also observed some artifacts in a rendered image from the scene 003 included in the static 32 splits.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants