Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add relative increase criterion for early stopping #1202

Open
thvasilo opened this issue Mar 5, 2025 · 0 comments
Open

Add relative increase criterion for early stopping #1202

thvasilo opened this issue Mar 5, 2025 · 0 comments
Labels
0.5 enhancement New feature or request good first issue Good for newcomers

Comments

@thvasilo
Copy link
Contributor

thvasilo commented Mar 5, 2025

Currently early stop has two strategies that only trigger if a validation metric decreases with two criteria:

There are two strategies: 1) consecutive_increase, early stop is triggered if the current validation score is lower than the average of the last early_stop_rounds validation scores and 2) average_increase, early stop is triggered if for the last early_stop_rounds consecutive steps, the validation scores are decreasing.

However there is the possibility of a metric becoming "stuck" with very minor increases to its value e.g.

Image

To address this case we should add relative increase parameter that will trigger early stop also in the cases where the metric has not improved for more than e.g. 1%. That way we can stop training when a metric plateaus.

@thvasilo thvasilo added enhancement New feature or request good first issue Good for newcomers 0.5 labels Mar 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.5 enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant