This is an automated email from the ASF dual-hosted git repository.
xtsong pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from c3e72be836e [FLINK-28495][docs][docs-zh] Fix typos or mistakes of
Flink CEP Document. This closes #20272
new fc619df9b52 [hotfix] Make HsMemoryDataManager runWithLockMethod
private.
new 42f05f0cddd [hotfix] HsMemoryDataManager spillAsync's callback should
assertNoException.
new 9cde5322969 [hotfix] Rename HsResultPartitionReadScheduler to
HsFileDataManager Rename HsResultPartitionReadScheduler to HsFileDataManager
as it plays the same role of FileDataManager mentioned in FLIP.
new f3bbb6b6a9b [hotfix] Simplify the logic related to release and fail
reader in HsFileDataManager.
new 9331e7502e9 [FLINK-27908] HsBufferContext ignore repeatedly
startSpilling and release instead of checkState.
new e930077b905 [FLINK-27908] ResultPartition's subclass using
setupInternal instead of setup to do initialization work.
new 828b3a58aca [FLINK-27908] Extends onResultPartitionClosed to
HsSpillingStrategy.
new 0d185b86bd4 [FLINK-27908] Add lifecycle method to HsFileDataManager,
HsMemoryDataManager and HsMemoryDataSpiller.
new e2d50c4777d [FLINK-27908] HybridShuffleConfiguration supports set
spilling strategy type.
new 347423f8464 [FLINK-27908] Let HsMemoryDataManager can register
HsSubpartitionViewInternalOperations and supports notifyDataAvailable.
new d0b13381483 [FLINK-27908] Introduce HsSubpartitionView based on
HsDataView and it's implementations.
new fed2962d3a2 [FLINK-27908] Introduce HsResultPartition
new 4a2f3a15903 [FLINK-27908] ResultPartitionFactory also supports HYBRID
type.
The 13 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../partition/BufferWritingResultPartition.java | 4 +-
.../io/network/partition/ResultPartition.java | 4 +
.../network/partition/ResultPartitionFactory.java | 22 +
.../io/network/partition/ResultPartitionType.java | 2 +-
.../partition/SortMergeResultPartition.java | 4 +-
.../network/partition/hybrid/HsBufferContext.java | 22 +-
.../io/network/partition/hybrid/HsDataView.java | 60 +++
...onReadScheduler.java => HsFileDataManager.java} | 81 ++--
.../partition/hybrid/HsFullSpillingStrategy.java | 20 +
.../partition/hybrid/HsMemoryDataManager.java | 104 +++--
.../hybrid/HsMemoryDataManagerOperation.java | 7 +
.../partition/hybrid/HsMemoryDataSpiller.java | 37 +-
.../partition/hybrid/HsResultPartition.java | 266 ++++++++++++
.../hybrid/HsSelectiveSpillingStrategy.java | 20 +
.../partition/hybrid/HsSpillingStrategy.java | 15 +
.../partition/hybrid/HsSubpartitionFileReader.java | 6 +-
.../hybrid/HsSubpartitionFileReaderImpl.java | 90 +++-
.../hybrid/HsSubpartitionMemoryDataManager.java | 67 ++-
.../partition/hybrid/HsSubpartitionView.java | 262 ++++++++++++
.../HsSubpartitionViewInternalOperations.java | 4 +-
.../hybrid/HybridShuffleConfiguration.java | 32 +-
.../partition/ResultPartitionFactoryTest.java | 16 +
.../partition/hybrid/HsBufferContextTest.java | 17 +-
...hedulerTest.java => HsFileDataManagerTest.java} | 87 ++--
.../hybrid/HsFullSpillingStrategyTest.java | 33 ++
.../partition/hybrid/HsMemoryDataManagerTest.java | 30 +-
.../partition/hybrid/HsMemoryDataSpillerTest.java | 42 +-
.../partition/hybrid/HsResultPartitionTest.java | 476 +++++++++++++++++++++
.../hybrid/HsSelectiveSpillingStrategyTest.java | 32 ++
.../hybrid/HsSubpartitionFileReaderImplTest.java | 88 +++-
.../HsSubpartitionMemoryDataManagerTest.java | 20 +-
.../partition/hybrid/HsSubpartitionViewTest.java | 313 ++++++++++++++
.../partition/hybrid/TestingHsDataView.java | 127 ++++++
.../hybrid/TestingMemoryDataManagerOperation.java | 21 +-
.../partition/hybrid/TestingSpillingStrategy.java | 23 +-
.../TestingSubpartitionViewInternalOperation.java | 2 +-
36 files changed, 2258 insertions(+), 198 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsDataView.java
rename
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/{HsResultPartitionReadScheduler.java
=> HsFileDataManager.java} (89%)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartition.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionView.java
rename
flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/{HsResultPartitionReadSchedulerTest.java
=> HsFileDataManagerTest.java} (84%)
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionTest.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionViewTest.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/TestingHsDataView.java
