This is an automated email from the ASF dual-hosted git repository.
pnowojski pushed a change to branch release-1.19
in repository https://gitbox.apache.org/repos/asf/flink.git
from 204db68ac41 [FLINK-36004] Deep copy the BinaryArrayData in
ArrayDataSerializer#copy while using custom ArrayData (#25196) (#25209)
new f10d5e3be03 [hotfix] Refactor SourceOperatorSlitWatermarkAlignmentTest
and support pausing splits in MockSourceReader
new 75828335870 [hotfix][test] Do not add three splits with the same
splitId in testMetrics
new cc91a024a70 [FLINK-35886][task] Define RelativeClock interface
new 7cd94768252 [FLINK-35886][task] Support markStart and markEnd
listeners in TimerGauge
new 9ecc8c74c3c [FLINK-35886][task] Implement PausableRelativeClock
new 0637e96e295 [FLINK-35886][task] Use RelativeClock in
WatermarksWithIdleness
new 25250a47e10 [FLINK-35886][task] Expose Clock from ProcessingTimeService
new dedd467f5fe [FLINK-35886][task] Hide backpressure from idleness
detection in TimestampsAndWatermarksOperator
new 74d47efaf9d [FLINK-35886][task] Hide backpressure and watermark
alignment from idleness detection in SourceOperator
new 70b0b695d13 [FLINK-35886][task] Hide backpressure from idleness
detection in WatermarkAssignerOperator
new 45a2e04e414 [FLINK-35886][source] Do not track already finished splits
in watermark alignment
new 5da82f8ca4e [FLINK-35886][source] Exclude japi checks for the API
changes
The 12 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../eventtime/WatermarkGeneratorSupplier.java | 12 +-
.../eventtime/WatermarkStrategyWithIdleness.java | 4 +-
.../common/eventtime/WatermarksWithIdleness.java | 25 +-
.../java/org/apache/flink/util/clock/Clock.java | 2 +-
.../org/apache/flink/util/clock/RelativeClock.java | 17 +-
.../common/eventtime/WatermarkStrategyTest.java | 85 +------
.../connector/source/mocks/MockSourceReader.java | 39 ++-
.../flink/table/toolbox/TestSourceFunction.java | 17 +-
.../runtime/NeverFireProcessingTimeService.java | 6 +-
.../apache/flink/runtime/metrics/TimerGauge.java | 60 ++++-
.../runtime/metrics/groups/TaskIOMetricGroup.java | 10 +
.../CheckpointCoordinatorMasterHooksTest.java | 4 +-
.../CheckpointCoordinatorTestingUtils.java | 4 +-
.../flink/runtime/metrics/TimerGaugeTest.java | 58 +++++
.../streaming/api/operators/SourceOperator.java | 32 ++-
.../source/NoOpTimestampsAndWatermarks.java | 6 +
.../source/ProgressiveTimestampsAndWatermarks.java | 80 ++++++-
.../operators/source/TimestampsAndWatermarks.java | 50 +++-
.../source/TimestampsAndWatermarksContext.java | 11 +-
.../operators/source/WatermarkToDataOutput.java | 3 +
.../api/operators/util/PausableRelativeClock.java | 96 ++++++++
.../operators/TimestampsAndWatermarksOperator.java | 36 ++-
.../runtime/tasks/ProcessingTimeService.java | 10 +
.../runtime/tasks/ProcessingTimeServiceImpl.java | 5 +-
.../runtime/tasks/SystemProcessingTimeService.java | 6 +-
.../runtime/tasks/TestProcessingTimeService.java | 66 +++++-
.../SourceOperatorSplitWatermarkAlignmentTest.java | 264 ++++++++++++++++++---
.../operators/util/PausableRelativeClockTest.java | 80 +++++++
.../TimestampsAndWatermarksOperatorTest.java | 44 ++++
.../runtime/tasks/MultipleInputStreamTaskTest.java | 4 +-
.../util/AbstractStreamOperatorTestHarness.java | 4 +
.../factories/TestValuesRuntimeFunctions.java | 17 +-
.../codegen/WatermarkGeneratorCodeGenTest.scala | 5 +-
.../wmassigners/WatermarkAssignerOperator.java | 21 +-
.../wmassigners/WatermarkAssignerOperatorTest.java | 29 +++
pom.xml | 4 +
36 files changed, 1023 insertions(+), 193 deletions(-)
copy
flink-connectors/flink-connector-base/src/main/java/org/apache/flink/connector/base/table/options/ConfigurationValidator.java
=> flink-core/src/main/java/org/apache/flink/util/clock/RelativeClock.java
(62%)
create mode 100644
flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/util/PausableRelativeClock.java
create mode 100644
flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/util/PausableRelativeClockTest.java