This is an automated email from the ASF dual-hosted git repository.
sewen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 8ae382c [FLINK-21346][hotfix] Revert installing required bc for e2e
tests
new 11717ce [hotfix][coordination] Add Main-Thread check to OperatorEvent
sending on Execution.
new 07fc447 [FLINK-18071][coordination] (part 2)
OperatorCoordinatorHolder does not implement OperatorCoordinator interface any
more
new 605d158 [FLINK-18071][coordination] (part 3) Adjust
OperatorEventValve to accept self-contained "send actions".
new 58c5e8c [FLINK-18071][coordination] (part 4) Add to Execution a
future for states INITIALIZING/RUNNING
new 4b51987 [FLINK-18071][coordination] (part 5) Communication from
Coordinators to Tasks happens through gateways that are scoped to a single
execution attempt.
new 2a225d6 [hotfix][coordination] Make failed event valve shutting
smoother.
new b1e1860 [hotfix][coordination] Reduce lambda nesting for action on
CompletableFuture
new 7f01aec [hotfix][coordination] Remove unnecessary null check
new f858348 [hotfix][tests] Minor debuggability improvements to
CoordinatedSourceRescaleITCase
new e3d2e1c [hotfix][tests] Simplify and harden
CoordinatorEventsExactlyOnceITCase
The 10 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../reader/CoordinatedSourceRescaleITCase.java | 11 +-
.../flink/runtime/executiongraph/Execution.java | 31 ++-
.../coordination/ExecutionSubtaskAccess.java | 118 +++++++++
.../coordination/OperatorCoordinator.java | 82 +++++-
.../coordination/OperatorCoordinatorHolder.java | 163 +++++++-----
.../operators/coordination/OperatorEventValve.java | 129 +++------
.../RecreateOnResetOperatorCoordinator.java | 17 +-
.../operators/coordination/SubtaskAccess.java | 87 ++++++
.../operators/coordination/SubtaskGatewayImpl.java | 84 ++++++
.../coordination/TaskNotRunningException.java | 5 +
.../util/IncompleteFuturesTracker.java | 103 ++++++++
.../flink/runtime/scheduler/DefaultScheduler.java | 5 +-
.../flink/runtime/scheduler/SchedulerBase.java | 2 +-
.../source/coordinator/SourceCoordinator.java | 11 +
.../coordinator/SourceCoordinatorContext.java | 54 +++-
.../CoordinatorEventsExactlyOnceITCase.java | 238 ++++++++++++++---
.../coordination/EventReceivingTasks.java | 223 ++++++++++++++++
.../coordination/MockOperatorCoordinator.java | 5 +
.../MockOperatorCoordinatorContext.java | 53 +---
.../OperatorCoordinatorHolderTest.java | 191 ++++++--------
.../OperatorCoordinatorSchedulerTest.java | 27 +-
.../coordination/OperatorEventValveTest.java | 132 ++++------
.../RecreateOnResetOperatorCoordinatorTest.java | 38 +--
.../operators/coordination/TestEventSender.java | 109 --------
.../coordination/TestingOperatorCoordinator.java | 21 +-
.../util/IncompleteFuturesTrackerTest.java | 105 ++++++++
.../coordinator/SourceCoordinatorContextTest.java | 97 ++++---
.../source/coordinator/SourceCoordinatorTest.java | 293 ++++++++-------------
.../coordinator/SourceCoordinatorTestBase.java | 117 ++++++--
.../source/coordinator/TestingSplitEnumerator.java | 255 ++++++++++++++++++
.../collect/CollectSinkOperatorCoordinator.java | 5 +
31 files changed, 1941 insertions(+), 870 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/operators/coordination/ExecutionSubtaskAccess.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/operators/coordination/SubtaskAccess.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/operators/coordination/SubtaskGatewayImpl.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/operators/coordination/util/IncompleteFuturesTracker.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/operators/coordination/EventReceivingTasks.java
delete mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/operators/coordination/TestEventSender.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/operators/coordination/util/IncompleteFuturesTrackerTest.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/source/coordinator/TestingSplitEnumerator.java
