Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Specs/grains observation #1573

Merged
merged 70 commits into from
Nov 30, 2024
Merged

Specs/grains observation #1573

merged 70 commits into from
Nov 30, 2024

Conversation

woksin
Copy link
Contributor

@woksin woksin commented Nov 28, 2024

Summary

In the process of adding specs to the Observation system many smaller issues were discovered and fixed. Along with general code cleanup and refactoring.

Added

  • More Logging
  • Replaying and CatchingUp partitions to ObserverState

Changed

  • Various code in the kernel to make it cleaner and more robust

Fixed

Removed

  • Handled from ObserverState counting the number of handled events. This can be done differently in the future

…atching up events for partitions after retrying or handling failed partitions
… so that it saves its grain state after it is changed
…tate and can handle events in a specified range instead of always all events
@woksin woksin added the patch label Nov 28, 2024
Source/Api/Api.csproj Outdated Show resolved Hide resolved
@woksin woksin requested a review from einari November 28, 2024 14:50
@woksin
Copy link
Contributor Author

woksin commented Nov 28, 2024

Follow up tasks from this is to go over the job system with specs and then move over to through integration testing

Copy link
Contributor

@einari einari left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work! Much needed refactorings!

Copy link
Contributor

@einari einari left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving the rest of the PR, as long as it builds with the proposed changes

@woksin woksin force-pushed the specs/grains-observation branch from c894173 to 214a772 Compare November 29, 2024 21:40
@woksin woksin merged commit ca4f97b into main Nov 30, 2024
12 of 13 checks passed
@woksin woksin deleted the specs/grains-observation branch December 2, 2024 08:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
2 participants