Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于predictive module #7

Open
Feynman1999 opened this issue Sep 11, 2023 · 5 comments
Open

关于predictive module #7

Feynman1999 opened this issue Sep 11, 2023 · 5 comments

Comments

@Feynman1999
Copy link

图像rescaling任务中,一般没有这个predictive module,请问这里如果不使用这一结构,还是sample from normal distribution,让网络自己学z的分布,结果如何?期待您的指点~

@ding3820
Copy link
Owner

Hi,
If I remember correctly, I had done such experiments by removing predictive module and learning z itself. I even tried with auxiliary loss function but the performance was just not as good as the presented one. The intuition is the latent variable z might actually carry some useful information needed to reconstruct the images/video. Due to the special structure of Invertible neural network, this z can actually be whatever the model likes it to be. This is my understanding and it has been a long time since I finished the research. There might be another new researches going on. Hope this help.

@Feynman1999
Copy link
Author

thank you for reply! It seems that there is very little work related to video rescaling? Do you think there is still room for research in this direction?

@Feynman1999
Copy link
Author

By the way, is there no checkpoint available? It would be very helpful for me to have a pre trained model

@ding3820
Copy link
Owner

Frankly speaking, the image/video rescaling task might not worth digging in. But it has great potential to extend to various tasks such as image/video compression. Honestly, I haven't been doing this line of research for a while so this is just my humble thought.

About checkpoints, sorry that I have no access to my school account anymore. I don't have copy either.

@ding3820
Copy link
Owner

ding3820 commented Sep 12, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants