New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question] layer wise learning rate with both mae and eva02 #375

Open

chagmgang opened this issue Mar 13, 2025 · 0 comments

chagmgang commented Mar 13, 2025

The mae and eva02 are vision transformer.
I think that the layer wise lr factor function has to be applied both or not.
however, eva02 apply the layer wise lr factor function in here. mae do not apply the layer wise lr factor function in here.
I want to know the reason of difference.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment