This is an automated email from the ASF dual-hosted git repository.
dmvk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from 3a3b724136e [FLINK-34150][ci] Enables local file sink e2e tests in
general CI setups
new 161378ad3a2 [FLINK-34063][runtime] Always flush compression buffers,
when retrieving stream position during OperatorState snapshot.
new 006a0869e32 [FLINK-34063][test-utils] Add
ExecutionOptions.SNAPSHOT_COMPRESSION to randomized checkpointing options.
new 6f76982e264 [FLINK-34063][runtime] Fix
CompressibleFSDataInputStream#seek in case of partial reads.
new d536b5a7d73 [FLINK-34063][runtime] Operator states need to be restored
in an order they've been written for the compression to work properly on empty
states.
new b7c314b46ac [FLINK-34063][runtime] Fix OperatorState repartitioning
when compression is enabled. We should only write compression headers once, at
the end of the "value" part of the serialized stream, to make sure we can
always seek to a split point.
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../state/CompressibleFSDataInputStream.java | 6 +
.../state/CompressibleFSDataOutputStream.java | 6 +-
...efaultOperatorStateBackendSnapshotStrategy.java | 31 +--
.../state/OperatorStateRestoreOperation.java | 71 ++---
.../state/CompressibleFSDataInputStreamTest.java | 142 ++++++++++
.../state/OperatorStateRestoreOperationTest.java | 285 +++++++++++++++++----
.../streaming/util/TestStreamEnvironment.java | 2 +
7 files changed, 420 insertions(+), 123 deletions(-)
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/state/CompressibleFSDataInputStreamTest.java
