Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: Add optional reject future samples parameter #603

Open
deathalt opened this issue Dec 17, 2024 · 0 comments
Open

Feature request: Add optional reject future samples parameter #603

deathalt opened this issue Dec 17, 2024 · 0 comments

Comments

@deathalt
Copy link
Contributor

Sometimes due to third party errors in qryn, assets are written from the future, for example from the year 2147, and these logs can be many, and the year can be random.
If an asset is too old, it will be deleted by TTL clickhouse, but the future assets will be written to the new clickhouse partition, which may result in a lot of partitions and directly affect performance.
It would be nice to have a flag configured to drop these assemblies on the qryn side, because removing them from the clickhouse can be problematic.

So it would be great to have parameters like:

reject_future_samples: true|false (false by default)
reject_future_samples.max_future_time: 1h|1d|1w|1y (..etc)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant