Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

right eye image alteration #17

Open
carlobs opened this issue Jan 17, 2025 · 6 comments
Open

right eye image alteration #17

carlobs opened this issue Jan 17, 2025 · 6 comments

Comments

@carlobs
Copy link

carlobs commented Jan 17, 2025

I found differences in the color of the right image, with even brightness changes, making the right image appear defective and the whole thing very annoying

@xiaoyu258
Copy link
Contributor

Our model relies on the generation ability of the SVD and its VAE for compression, which may produce some artifacts in which the SVD or its VAE is hard to generate.

Could you show the example you test?

@carlobs
Copy link
Author

carlobs commented Jan 20, 2025

I rendered a short clip for you, the artefacts are only in the inpainting Right Eye, not in the splatted clip.
View in 4K and you can see flashing every 1 seconds and red dominance over the full frame.

https://youtu.be/QHBK3rG91zQ

@xiaoyu258
Copy link
Contributor

Thanks for your sharing. I could see it now. I have not seen this severe artifact before in my examples.

Does it happen in other cases? How about the results in lower resolutions like 2K or 1080p?
What are the values of "--max_disp" and "--tile_num" you used?

@Archit01
Copy link

Archit01 commented Jan 21, 2025

I rendered a short clip for you, the artefacts are only in the inpainting Right Eye, not in the splatted clip. View in 4K and you can see flashing every 1 seconds and red dominance over the full frame.

https://youtu.be/QHBK3rG91zQ

Depth interference should have window size of atleast 75 and overlap of 25 for depth crafter. Also use depth resolution of max 512.

@carlobs
Copy link
Author

carlobs commented Jan 22, 2025

Thanks for your sharing. I could see it now. I have not seen this severe artifact before in my examples.

Does it happen in other cases? How about the results in lower resolutions like 2K or 1080p? What are the values of "--max_disp" and "--tile_num" you used?

I used --max_didp 20 and --tile_num 2 with RTX4090
the video resolution of source is 1920x820; to obtain a FSBS 3840x820

the flashing period of brightness depend of frames_chunk parameter, the 23 default cause the period of about 1 second (because 24 fps in source clip).... frames_chunk=48 cause the period of 2 seconds...

@carlobs
Copy link
Author

carlobs commented Jan 22, 2025

Depth interference should have window size of atleast 75 and overlap of 25 for depth crafter. Also use depth resolution of max 512.

I tried, the result didn't change

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants