This is an automated email from the ASF dual-hosted git repository.
guoweijie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from d774cf1bdea [FLINK-37139][table-planner] Improve
AdaptiveSkewedJoinOptimizationStrategy to make it effective in more scenarios
(#25989)
new 577d5caa923 [hotfix] Add missing generic type param for the use of
PartitionedContext
new 3d146af119e [FLINK-37135][API] Introduce JoinFunction, JoinType and
BuiltinFuncs for Join extension in DataStream V2
new b3e7f9bd972 [FLINK-37135][runtime] Implement Join extension for
DataStream V2
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../flink/datastream/api/builtin/BuiltinFuncs.java | 124 +++++++
.../join/JoinFunction.java} | 31 +-
.../datastream/api/extension/join/JoinType.java | 21 +-
.../api/function/ApplyPartitionFunction.java | 2 +-
.../function/OneInputStreamProcessFunction.java | 6 +-
.../TwoInputBroadcastStreamProcessFunction.java | 5 +-
.../TwoInputNonBroadcastStreamProcessFunction.java | 9 +-
.../function/TwoOutputApplyPartitionFunction.java | 2 +-
.../function/TwoOutputStreamProcessFunction.java | 4 +-
.../datastream/impl/builtin/BuiltinJoinFuncs.java | 38 ++
.../TwoInputNonBroadcastJoinProcessFunction.java | 59 ++++
.../TwoInputNonBroadcastJoinProcessOperator.java | 110 ++++++
.../impl/stream/KeyedPartitionStreamImpl.java | 53 ++-
.../flink/datastream/impl/utils/StreamUtils.java | 17 +
.../impl/ExecutionEnvironmentImplTest.java | 2 +-
...treamingJobGraphGeneratorWithAttributeTest.java | 6 +-
.../impl/functions/ProcessFunctionTest.java | 18 +-
.../impl/operators/KeyedProcessOperatorTest.java | 6 +-
.../KeyedTwoInputBroadcastProcessOperatorTest.java | 6 +-
...yedTwoInputNonBroadcastProcessOperatorTest.java | 18 +-
.../KeyedTwoOutputProcessOperatorTest.java | 6 +-
.../operators/MockFreqCountProcessFunction.java | 3 +-
.../MockGlobalDecuplicateCountProcessFunction.java | 3 +-
.../MockGlobalListAppenderProcessFunction.java | 3 +-
.../operators/MockListAppenderProcessFunction.java | 3 +-
.../operators/MockMultiplierProcessFunction.java | 3 +-
.../MockRecudingMultiplierProcessFunction.java | 3 +-
.../operators/MockSumAggregateProcessFunction.java | 3 +-
.../impl/operators/ProcessOperatorTest.java | 2 +-
.../TwoInputBroadcastProcessOperatorTest.java | 4 +-
.../TwoInputNonBroadcastProcessOperatorTest.java | 14 +-
.../operators/TwoOutputProcessOperatorTest.java | 4 +-
.../datastream/impl/stream/StreamTestUtils.java | 12 +-
.../datastream/impl/utils/StreamUtilsTest.java | 14 +-
.../datastream/impl/utils/WatermarkUtilsTest.java | 4 +-
.../test/streaming/api/datastream/JoinITCase.java | 387 +++++++++++++++++++++
.../api/datastream/StatefulDataStreamV2ITCase.java | 18 +-
.../streaming/api/datastream/WatermarkITCase.java | 6 +-
38 files changed, 918 insertions(+), 111 deletions(-)
create mode 100644
flink-datastream-api/src/main/java/org/apache/flink/datastream/api/builtin/BuiltinFuncs.java
copy
flink-datastream-api/src/main/java/org/apache/flink/datastream/api/{function/TwoOutputApplyPartitionFunction.java
=> extension/join/JoinFunction.java} (54%)
copy
flink-core-api/src/main/java/org/apache/flink/api/common/typeinfo/TypeDescriptor.java
=>
flink-datastream-api/src/main/java/org/apache/flink/datastream/api/extension/join/JoinType.java
(64%)
create mode 100644
flink-datastream/src/main/java/org/apache/flink/datastream/impl/builtin/BuiltinJoinFuncs.java
create mode 100644
flink-datastream/src/main/java/org/apache/flink/datastream/impl/extension/join/operators/TwoInputNonBroadcastJoinProcessFunction.java
create mode 100644
flink-datastream/src/main/java/org/apache/flink/datastream/impl/extension/join/operators/TwoInputNonBroadcastJoinProcessOperator.java
create mode 100644
flink-tests/src/test/java/org/apache/flink/test/streaming/api/datastream/JoinITCase.java
