This is an automated email from the ASF dual-hosted git repository.
dmvk pushed a change to branch release-1.18
in repository https://gitbox.apache.org/repos/asf/flink.git
from 6e96772f8d5 [FLINK-34150][ci] Enables local file sink e2e tests in
general CI setups
new 1cd68f954ee [FLINK-34063][runtime] Always flush compression buffers,
when retrieving stream position during OperatorState snapshot.
new 5e40a556011 [FLINK-34063][test-utils] Add
ExecutionOptions.SNAPSHOT_COMPRESSION to randomized checkpointing options.
new c334cbf2496 [FLINK-34063][runtime] Fix
CompressibleFSDataInputStream#seek in case of partial reads.
new 5136c2513b4 [FLINK-34063][runtime] Operator states need to be restored
in an order they've been written for the compression to work properly on empty
states.
new e39559895ab [FLINK-34063][runtime] Fix OperatorState repartitioning
when compression is enabled. We should only write compression headers once, at
the end of the "value" part of the serialized stream, to make sure we can
always seek to a split point.
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../state/CompressibleFSDataInputStream.java | 6 +
.../state/CompressibleFSDataOutputStream.java | 6 +-
...efaultOperatorStateBackendSnapshotStrategy.java | 31 +--
.../state/OperatorStateRestoreOperation.java | 71 ++---
.../state/CompressibleFSDataInputStreamTest.java | 142 ++++++++++
.../state/OperatorStateRestoreOperationTest.java | 285 +++++++++++++++++----
.../streaming/util/TestStreamEnvironment.java | 2 +
7 files changed, 420 insertions(+), 123 deletions(-)
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/state/CompressibleFSDataInputStreamTest.java
