Skip to content

[To dev/1.3] fix(pipe): reuse safe local progress on alter (#18423) - #18444

Open
Caideyipi wants to merge 1 commit into
apache:dev/1.3from
Caideyipi:cp-ef0a792a-dev-1.3
Open

[To dev/1.3] fix(pipe): reuse safe local progress on alter (#18423)#18444
Caideyipi wants to merge 1 commit into
apache:dev/1.3from
Caideyipi:cp-ef0a792a-dev-1.3

Conversation

@Caideyipi

Copy link
Copy Markdown
Collaborator

Summary

  • Backport fix(pipe): reuse safe local progress on alter #18423 (ef0a792a3aafe8ff4b3261c973881b39e890ddcf) to dev/1.3.
  • Reuse a safe local committed PipeTask progress during alter when the realtime-only mode and leader remain unchanged, while preserving coordinator progress and explicit mode-reset semantics.
  • Collect the latest leader checkpoints before alter and process the dropped/updated PipeMeta entries in one DataNode task-agent invocation.
  • Adapt the change to the dev/1.3 extractor parameter, PipeMeta keeper, and heartbeat parser APIs.

Verification

  • Spotless passed for ConfigNode, DataNode, and integration-test.
  • PipeDataNodeTaskAgentTest and DataNodeInternalRPCServiceImplPushMultiPipeMetaTest: 14 targeted tests passed.
  • ConfigNode main/test compilation passed.
  • Integration-test main/test compilation passed with with-integration-tests.
  • git diff --check origin/dev/1.3..HEAD

* fix(pipe): reuse safe local progress on alter

* fix(pipe): collect latest progress before alter
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant