This is an automated email from the ASF dual-hosted git repository.
pnowojski pushed a change to branch release-1.20
in repository https://gitbox.apache.org/repos/asf/flink.git
from 9601e06bab1 [FLINK-36004] Deep copy the BinaryArrayData in
ArrayDataSerializer#copy while using custom ArrayData (#25196) (#25208)
new d1fe68e3358 [hotfix] Refactor SourceOperatorSlitWatermarkAlignmentTest
and support pausing splits in MockSourceReader
new 3eac97f70a3 [hotfix][test] Do not add three splits with the same
splitId in testMetrics
new c79854e113e [FLINK-35886][task] Define RelativeClock interface
new 756f8cfafb2 [FLINK-35886][task] Support markStart and markEnd
listeners in TimerGauge
new b8ab2d66e04 [FLINK-35886][task] Implement PausableRelativeClock
new a1c364ed64e [FLINK-35886][task] Use RelativeClock in
WatermarksWithIdleness
new 17049863e3e [FLINK-35886][task] Expose Clock from ProcessingTimeService
new deecdc1b8dd [FLINK-35886][task] Hide backpressure from idleness
detection in TimestampsAndWatermarksOperator
new 65837f83e39 [FLINK-35886][task] Hide backpressure and watermark
alignment from idleness detection in SourceOperator
new c7dcee149eb [FLINK-35886][task] Hide backpressure from idleness
detection in WatermarkAssignerOperator
new 62750753ad4 [FLINK-35886][source] Do not track already finished splits
in watermark alignment
The 11 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../eventtime/WatermarkGeneratorSupplier.java | 12 +-
.../eventtime/WatermarkStrategyWithIdleness.java | 4 +-
.../common/eventtime/WatermarksWithIdleness.java | 25 +-
.../java/org/apache/flink/util/clock/Clock.java | 2 +-
.../org/apache/flink/util/clock/RelativeClock.java | 24 +-
.../common/eventtime/WatermarkStrategyTest.java | 15 +-
.../connector/source/mocks/MockSourceReader.java | 39 ++-
.../flink/table/toolbox/TestSourceFunction.java | 17 +-
.../runtime/NeverFireProcessingTimeService.java | 6 +-
.../apache/flink/runtime/metrics/TimerGauge.java | 60 ++++-
.../runtime/metrics/groups/TaskIOMetricGroup.java | 10 +
.../flink/runtime/metrics/TimerGaugeTest.java | 58 +++++
.../streaming/api/operators/SourceOperator.java | 32 ++-
.../source/NoOpTimestampsAndWatermarks.java | 6 +
.../source/ProgressiveTimestampsAndWatermarks.java | 80 ++++++-
.../operators/source/TimestampsAndWatermarks.java | 49 +++-
.../source/TimestampsAndWatermarksContext.java | 11 +-
.../operators/source/WatermarkToDataOutput.java | 3 +
.../api/operators/util/PausableRelativeClock.java | 96 ++++++++
.../operators/TimestampsAndWatermarksOperator.java | 36 ++-
.../runtime/tasks/ProcessingTimeService.java | 10 +
.../runtime/tasks/ProcessingTimeServiceImpl.java | 5 +-
.../runtime/tasks/SystemProcessingTimeService.java | 6 +-
.../runtime/tasks/TestProcessingTimeService.java | 66 +++++-
.../SourceOperatorSplitWatermarkAlignmentTest.java | 262 ++++++++++++++++++---
.../operators/util/PausableRelativeClockTest.java | 80 +++++++
.../TimestampsAndWatermarksOperatorTest.java | 42 ++++
.../runtime/tasks/MultipleInputStreamTaskTest.java | 4 +-
.../util/AbstractStreamOperatorTestHarness.java | 4 +
.../factories/TestValuesRuntimeFunctions.java | 17 +-
.../codegen/WatermarkGeneratorCodeGenTest.scala | 5 +-
.../wmassigners/WatermarkAssignerOperator.java | 21 +-
.../wmassigners/WatermarkAssignerOperatorTest.java | 29 +++
33 files changed, 1014 insertions(+), 122 deletions(-)
copy
flink-connectors/flink-connector-base/src/main/java/org/apache/flink/connector/base/sink/writer/ResultHandler.java
=> flink-core/src/main/java/org/apache/flink/util/clock/RelativeClock.java
(62%)
create mode 100644
flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/util/PausableRelativeClock.java
create mode 100644
flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/util/PausableRelativeClockTest.java
