Code

FEATURE: Subscription Engine#5321

Code

Open

bwaidelich wants to merge 158 commits into9.0neos/neos-development-collection:9.0from feature/4746-rework-catchup-mechanism-3neos/neos-development-collection:feature/4746-rework-catchup-mechanism-3Copy head branch name to clipboard

+7,027-1,974

Commits

Commits on Oct 24, 2024

• WIP

  Show description for 2172f09
  bwaidelich

  committed
  2172f09

• Merge branch '9.0' into feature/4746-rework-catchup-mechanism-3

  bwaidelich

  committed
  13b1073

• Merge branch '9.0' into feature/4746-rework-catchup-mechanism-3

  bwaidelich

  committed
  d75f174

Commits on Oct 26, 2024

• Merge branch '9.0' into feature/4746-rework-catchup-mechanism-3

  Show description for 937f84d
  bwaidelich

  committed
  937f84d

Commits on Oct 29, 2024

• Merge branch '9.0' into feature/4746-rework-catchup-mechanism-3

  bwaidelich

  committed
  03fb7ca

Commits on Nov 3, 2024

• Merge branch '9.0' into feature/4746-rework-catchup-mechanism-3

  bwaidelich

  committed
  dcb4be2

Commits on Nov 5, 2024

• Merge branch '9.0' into feature/4746-rework-catchup-mechanism-3

  bwaidelich

  committed
  fafe080

• WIP

  bwaidelich

  committed
  29ba908

Commits on Nov 6, 2024

• Tweak type comments

  bwaidelich

  committed
  207179b

Commits on Nov 13, 2024

• Wiring...

  bwaidelich

  committed
  a127706

• Merge branch '9.0' into feature/4746-rework-catchup-mechanism-3

  Show description for 765b84f
  bwaidelich

  committed
  765b84f

Commits on Nov 14, 2024

• first (almost) working version

  bwaidelich

  committed
  5b035c1

• Fix CatchUpHooks

  bwaidelich

  committed
  aca0f9b

• Replace ProjectionService

  bwaidelich

  committed
  7fea53e

• remove EventPersister and much more :)

  bwaidelich

  committed
  ec08d64

• Remove RunSubscriptionEventStore

  bwaidelich

  committed
  9fef068

• Improve error handling (WIP)

  bwaidelich

  committed
  46ad9d1

Commits on Nov 17, 2024

• Merge branch '9.0' into feature/4746-rework-catchup-mechanism-3

  Show description for 5ea8fae
  bwaidelich

  committed
  5ea8fae

• Fix ContentRepositoryFactory constructor

  bwaidelich

  committed
  88cc600

• Improve error handling during SubscriptionEngine::setup()

  bwaidelich

  committed
  e3f85ac

Commits on Nov 18, 2024

• Allow to reset subscriptions

  Show description for c43a2ea
  bwaidelich

  committed
  c43a2ea

• Re-implement cr:status CLI command

  bwaidelich

  committed
  40e8d35

• Fix test_parallel cr settings

  Show description for 3744fd5
  bwaidelich

  committed
  3744fd5

• Fix test_parallel cr settings 2/2

  bwaidelich

  committed
  c0fbfe1

• Tweak subscription engine setup/reset from tests

  bwaidelich

  committed
  f5ff7d6

• Fix behat tests ?

  Show description for f8a8b5b
  bwaidelich

  committed
  f8a8b5b

• Disable EventExportProcessor test

  Show description for 1562435
  bwaidelich

  committed
  1562435

• Revert "Disable EventExportProcessor test"

  Show description for 2902dc2
  bwaidelich

  committed
  2902dc2

Commits on Nov 20, 2024

• TASK: Fix phpstan

  mhsdesign

  committed
  0fe05b5

• Merge remote-tracking branch 'origin/9.0' into feature/4746-rework-catchup-mechanism-3

  mhsdesign

  committed
  6e5b565

• TASK: Add sanity check assertion after setting node properties a couple of times

  mhsdesign

  committed
  8967ead

• TASK: Introduce dedicated contentRepositoryLogger

  mhsdesign

  committed
  2b5d338

• Fix parallel tests and publish events on correct stream

  mhsdesign

  committed
  2d3a136

• TASK: Simplify normalizeEvents

  mhsdesign

  committed
  46dc510

• Merge remote-tracking branch 'origin/9.0' into feature/4746-rework-catchup-mechanism-3

  mhsdesign

  committed
  0680533

• TASK: Test that locking and concurrent writing works under heavy load

  Show description for de92d79
  mhsdesign

  committed
  de92d79

• TASK: Improve exception thrown if subscriber failed

  mhsdesign

  committed
  f58cefa

• TASK: Fix of-by-one error in catchup

  Show description for e15ae79
  mhsdesign

  committed
  e15ae79

• TASK: Improve logging and simplify information on debug

  mhsdesign

  committed
  c7df820

• TASK: Remove obsolete ContentRepositorySubscribersFactoryInterface

  mhsdesign

  committed
  0bd129a

• TASK: Remove generic EventHandlerInterface for now, everything is a projection (can be later reintroduced)

  mhsdesign

  committed
  1dfaa2c

• TASK: Remove other generic subscription concepts not required for projections

  Show description for 441b035
  mhsdesign

  committed
  441b035

Commits on Nov 21, 2024

• TASK: Remove subscription groups and filtering except for status and ids

  Show description for 9c6ba75
  mhsdesign

  committed
  9c6ba75

• TASK: Remove $skipBooting because its an odd signature and unused

  mhsdesign

  committed
  0ac8751

• TASK: Remove removal of subscriptions

  Show description for 9be3308
  mhsdesign

  committed
  9be3308

• TASK: Remove sqlite support for DoctrineSubscriptionStore as db locking is untested there

  mhsdesign

  committed
  53790b9

• TASK: Inline ProjectionEventHandler to Subscriber and make it a SubscriberForProjection

  Show description for 481f173
  mhsdesign

  committed
  481f173

• TASK: Introduce tests for subscription booting, active and error state

  mhsdesign

  committed
  b9569c5

• TASK: Allow to replace setting of cr registry via injectSettings

  mhsdesign

  committed
  427829e

• TASK: Subscription engine test new and detached status

  mhsdesign

  committed
  715ec2e

• TASK: Speedup tests by using truncate

  mhsdesign

  committed
  512e3c4

• TASK: Subscription engine test filtering by subscription id

  mhsdesign

  committed
  408ceb2

Commits on Nov 22, 2024

• TASK: Subscription engine test filteringReset

  Show description for b71165c
  mhsdesign

  committed
  b71165c

• TASK: introduce DebugEventProjection for testing to assert each event is only handled once and further introspection

  mhsdesign

  committed
  c8f8c6a

• TASK: introduce test that projection is rollback'd in case of error

  mhsdesign

  committed
  91046e6

• TASK: test catchup hooks on failure

  mhsdesign

  committed
  f624ac6

Commits on Nov 23, 2024

• TASK: Introduce test to assert that projection keeps events previously applied in the same batch that did not cause errors

  mhsdesign

  committed
  0197017

• TASK: Improve catchup rollback test

  mhsdesign

  committed
  3b6ca26

• TASK: Split up mighty SubscriptionEngineTest

  mhsdesign

  committed
  794be11

• TASK: Simplify AbstractSubscriptionEngineTestCase by moving out special logic

  mhsdesign

  committed
  752d434

• TASK: Test error behaviour for onBeforeCatchUp and onAfterCatchUp

  mhsdesign

  committed
  c4da7fe

• TASK: Add test for happy catchup hooks

  mhsdesign

  committed
  c8cb0a2

• TASK: Adjust subscription test exceptions to do no retry

  Show description for dfe5eb3
  mhsdesign

  committed
  dfe5eb3

• TASK: Remove retry_attempt from subscriptions

  Show description for a32bfb2
  mhsdesign

  committed
  a32bfb2

• TASK: Rename factory back to $additionalSubscriberFactories

  Show description for 836c347
  mhsdesign

  committed
  836c347

• BUGFIX: discoverDetachedSubscriptions did not persist changes

  Show description for 830b5cc
  mhsdesign

  committed
  830b5cc

• Merge pull request #5375 from mhsdesign/task/radical-cleanup-for-subscription-pr

  Show description for 3d43183
  mhsdesign

  authored
  3d43183

• TASK: Fix phpstan

  mhsdesign

  committed
  6f43825

• BUGFIX: Reintroduce catchup hooks for all projections

  Show description for 60d4f8c
  mhsdesign

  committed
  60d4f8c

• TASK: Adjust to doctrine deprecations in DoctrineSubscriptionStore

  mhsdesign

  committed
  5ef4ab1

• TASK: Minor code adjustments

  mhsdesign

  committed
  c7cb75b

• TASK: Ensure that the content graph projection is not part of the generic ProjectionStates

  mhsdesign

  committed
  a80639b

• BUGFIX: ProjectionErrorTest::fixFailedProjection reset error on reset

  mhsdesign

  committed
  e7acfaa

• TASK: Assertions that setup and boot do not retry failed projections

  Show description for fdeec75
  mhsdesign

  committed
  fdeec75

• BUGFIX: SubscriptionDetachedStatusTest::projectionIsDetachedIfConfigurationIsRemoved

  Show description for 31913f5
  mhsdesign

  committed
  31913f5

• TASK: Throw CatchUpFailed exception in case onBeforeCatchUp or onAfterCatchUp failes

  Show description for c5ea757
  mhsdesign

  committed
  c5ea757

• TASK: Use save points to rollback projections during transaction on failure

  Show description for 794eaf2
  mhsdesign

  committed
  794eaf2

• TASK: Handle TableNotFoundException gracefully in subscriptionStatuses

  mhsdesign

  committed
  7852f61

• TASK: Move back to subscriptionStatuses test. We need to make sure the tables are dropped

  mhsdesign

  committed
  d582766

• TASK: Inline discoverDetachedSubscriptions

  Show description for 5dfa592
  mhsdesign

  committed
  5dfa592

• TASK: Do not discover new subscriptions during catchup

  Show description for d5715c7
  mhsdesign

  committed
  d5715c7

Commits on Nov 24, 2024

• TASK: Introduce further tests to assert behaviour for catchup and setup

  Show description for 37a4e47
  mhsdesign

  committed
  37a4e47

• BUGFIX: Setup must re-setup active projections for migrations

  mhsdesign

  committed
  a8f246b

• BUGFIX: Setup should reattach detached projections if possible, and mark detached ones as detached.

  mhsdesign

  committed
  73e1097

• FEATURE: Setup marks failed projections to be booted again

  mhsdesign

  committed
  6726d73

• FEATURE: Introduce ContentRepositoryMaintainer and restore cr:projection commands

  mhsdesign

  committed
  f46077e

• TASK: Rename ProjectionStatus and introduce ProjectionSubscriptionStatus

  Show description for bace8ff
  mhsdesign

  committed
  bace8ff

• TASK: Introduce DetachedSubscriptionStatus as the projection setup status cannot be calculated

  Show description for 8ff0f61
  mhsdesign

  committed
  8ff0f61

• TASK: Inline pruneAllWorkspacesAndContentStreamsFromEventStream into CR Maintainer

  mhsdesign

  committed
  9675572

• TASK: Reimplement 40e8d35

  Show description for 655ac3c
  mhsdesign

  committed
  655ac3c

• TASK: Document new ContentRepositoryMaintainer

  mhsdesign

  committed
  e235e69

Commits on Nov 25, 2024

• TASK: Rename ProjectionSetupStatus back to ProjectionStatus

  Show description for 611ca37
  mhsdesign

  committed
  611ca37

• TASK: Rename SubscriptionStatuses to SubscriptionStatusCollection

  mhsdesign

  committed
  0b8a3b5

• TASK: Leave warning hint for why we do a replay

  Show description for 51f0cf6
  mhsdesign

  committed
  51f0cf6

• TASK: Warn in catchupProjection if projection is not ready to be caught up

  mhsdesign

  committed
  a2a2411

• TASK: Document catchupProjection correctly

  mhsdesign

  committed
  63d1589

• TASK: Reintroduce ContentRepositoryStatus object and expose current event store position for debugging and status information

  mhsdesign

  committed
  2297c14

• TASK: Swap Projection and Setup in output so that Setup comes first

  mhsdesign

  committed
  1220f82

Commits on Nov 26, 2024

• WIP: Introduce cr:reactivateSubscription

  Show description for 800fd53
  mhsdesign

  committed
  800fd53

Commits on Nov 27, 2024

• TASK: Dont crash on status when the event store is not setup

  mhsdesign

  committed
  a0c9f90

• TASK: Split projection replay into separate SubscriptionCommandController

  Show description for 8c079d9
  mhsdesign

  committed
  8c079d9

• TASK: Status also shows new subscriptions even if they are not persistent yet

  mhsdesign

  committed
  4c65d81

• TASK: Refine todos

  Show description for 8c9c0e8
  mhsdesign

  committed
  8c9c0e8

• TASK: Declare SubscriptionEngine and friends as internal

  Show description for 4424483
  mhsdesign

  committed
  4424483

• TASK: Add error code to SubscriptionEngineAlreadyProcessingException

  mhsdesign

  committed
  baa5e4a

• TASK: Allow cr registry to implement internal subscription store because its framework

  mhsdesign

  committed
  66e54bc

• TASK: Rename to SubscriptionReplayProcessor

  mhsdesign

  committed
  51d39e5

• TASK: Improve legacy projectionReplayCommand stub

  mhsdesign

  committed
  b2c1a29

• TASK: Add test for Subscription & Cr Commands (and thus CRMaintainer)

  mhsdesign

  committed
  d84c2a4

• Merge pull request #5378 from mhsdesign/feature/content-repository-maintainer

  Show description for fd768da
  mhsdesign

  authored
  fd768da

• TASK: Remove SubscriptionManager and make subscriptions immutable

  Show description for ac425ff
  mhsdesign

  committed
  ac425ff

• FEATURE: Implement reactivateSubscription

  Show description for eb0d792
  mhsdesign

  committed
  eb0d792

• TASK: Move transactional logic _on_ projection as it does not belong to the subscription store

  Show description for dc5ff10
  mhsdesign

  committed
  dc5ff10

Commits on Dec 1, 2024

• SubscriptionEngineTest postgresql compatible

  kitsunet

  committed
  3448e21

• Add missing empty string check

  kitsunet

  committed
  5abdb0a

Commits on Dec 2, 2024

• TASK: Declare EventNormalizer as internal

  mhsdesign

  committed
  2b82f62

• TASK: Simplify SubscriberFactoryDependencies to only contain api things

  Show description for 4353f0f
  mhsdesign

  committed
  4353f0f

• TASK: Introduce getPropertyConverter to denote that this is really internal

  mhsdesign

  committed
  ea3eaa6

• TASK: Migrate checkpoints to subscriptions via migrateevents:migrateCheckpointsToSubscriptions

  mhsdesign

  committed
  e750d93

• TASK: Disable running subscription test on PostgreSQL

  Show description for 33b717a
  mhsdesign

  committed
  33b717a

• TASK: Remove obsolete todo

  mhsdesign

  committed
  9286afc

• Merge remote-tracking branch 'origin/9.0' into feature/4746-rework-catchup-mechanism-3

  mhsdesign

  committed
  d13c153

• TASK: Dont use new EventNormalizer() in tests

  mhsdesign

  committed
  34fd834

Commits on Dec 3, 2024

• TASK: Fix php cs

  mhsdesign

  committed
  caa70bf

• BUGFIX: Ensure onAfterCatchUp is always executed _after_ the projection is persisted. Even in error case.

  mhsdesign

  committed
  54b24b8

• TASK: Reactivate ParallelWritingInWorkspacesTest

  Show description for 4a7b058
  mhsdesign

  committed
  4a7b058

• TASK: Test ProjectionTransactionTrait when using external projections

  Show description for c47d181
  mhsdesign

  committed
  c47d181

• TASK: Implement that onAfterCatchUp called _after_ everything is persisted

  Show description for fd9faa4
  mhsdesign

  committed
  fd9faa4

• Move savepoint creation back on the subscription store

  Show description for 175ab4c
  mhsdesign

  committed
  175ab4c

• TASK: Adjust tests that exactly once delivery is not possible for external projections

  Show description for 582c5e6
  mhsdesign

  committed
  582c5e6

• TASK: Change that hooks are not executed in the same savepoint and do not put the projection in ERROR state

  Show description for bfb4655
  mhsdesign

  committed
  bfb4655

• TASK: Prevent catchup hooks from halting the projections

  Show description for aa2e7b1
  mhsdesign

  committed
  aa2e7b1

• TASK: Introduce dedicated CatchUpHadErrors exception

  mhsdesign

  committed
  bccea53

Commits on Dec 4, 2024

• TASK: Introduce test to assert behaviour when catchup hooks use the persistence manager

  mhsdesign

  committed
  4c41482

Commits on Dec 7, 2024

• TASK: Explain behaviour when handling multiple commands

  mhsdesign

  committed
  21318b2

• FEATURE: Introduce batching in subscription engine

  mhsdesign

  committed
  47fc20b

• FEATURE: Introduce onAfterBatchCompleted hook

  Show description for 6b59fdb
  mhsdesign

  committed
  6b59fdb

Commits on Dec 9, 2024

• TASK: Trivial cosmetic changes

  mhsdesign

  committed
  d04b8f3

• TASK: Update documentation of CatchUpHookInterface

  mhsdesign

  committed
  b852617

Commits on Dec 10, 2024

• TASK: Introduce test that we cannot roll-back setup

  Show description for 8daa836
  mhsdesign

  committed
  8daa836

• TASK: Remove use of save-points for projections

  Show description for 8f55975
  mhsdesign

  committed
  8f55975

• Fix DoctrineSubscriptionStore compatibility with SQLite and PostgreSQL

  bwaidelich

  committed
  79d4ec7

Commits on Dec 11, 2024

• Merge pull request #5392 from mhsdesign/task/subscription-engine-savepoint-simplication

  Show description for 6423dc6
  mhsdesign

  authored
  6423dc6

• Merge remote-tracking branch 'origin/9.0' into feature/4746-rework-catchup-mechanism-3

  mhsdesign

  committed
  42edc02

Commits on Dec 13, 2024

• TASK: Improve errors for catch hooks to only the first error the exception

  Show description for c3e3291
  mhsdesign

  committed
  c3e3291

• TASK: Replace transactional function use with explicit start and stop

  Show description for 542bd4e
  mhsdesign

  committed
  542bd4e

• TASK: Ensure that subscriptions are not catchup'd if "onBeforeCatchUp" was not invoked

  Show description for efa4165
  mhsdesign

  committed
  efa4165

• TASK: Add test to ensure transaction is not active during onAfterBatchCompleted and onAfterCatchUp

  mhsdesign

  committed
  202519c

• TASK: Only collect first Throwable object instance during catchup

  Show description for cc299c3
  mhsdesign

  committed
  cc299c3

• TASK: Improve message of CatchUpHadErrors by concatenating all errors (and clamping).

  mhsdesign

  committed
  431732e

• TASK: Log catchup hook errors directly and improve error output during replay

  mhsdesign

  committed
  3fa4122

• TASK: Add position of error to catchup error for better debug information

  mhsdesign

  committed
  2e76381

• TASK: Credit patchlevel in SubscriptionEngine

  mhsdesign

  committed
  cd384e5

• Merge remote-tracking branch 'origin/9.0' into feature/4746-rework-catchup-mechanism-3

  mhsdesign

  committed
  4d65f9c

• TASK: Adjust commitOnConnection_onAfterEvent test to batching

  Show description for d53c361
  mhsdesign

  committed
  d53c361

• TASK: Ensure status is serialized by value

  Show description for 24890b9
  mhsdesign

  committed
  24890b9

• BUGFIX: Ensure that replay does not reset new or detached projections

  mhsdesign

  committed
  ca79907

• TASK: Make phpcs happy

  mhsdesign

  committed
  dc97232