This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a change to branch release-1.7
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 1034f3e [FLINK-11044] [docs] Fix registerTableSink docs
new 60f21cc [hotfix][fs-connector] Refactor PartFileWriter to take stream.
new 1ef6bf8 [hotfix][fs-connector] Refactor Bucket to statically import
Preconditions.
new 3514c52 [hotfix][s3-connector] Renamed S3MultiPartUploader to
S3AccessHelper.
new a029f33 [hotfix] Consolidated all S3 accesses under the
S3AccessHelper.
new e32e233 [hotfix] Method renaming in the
RecoverableMultiPartUploadImpl.
new 5de5078 [FLINK-10963][fs-connector, s3] Cleanup tmp S3 objects
uploaded as backups of in-progress files.
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../apache/flink/core/fs/RecoverableWriter.java | 28 +++
.../core/fs/local/LocalRecoverableWriter.java | 10 +
.../runtime/fs/hdfs/HadoopRecoverableWriter.java | 10 +
.../fs/s3/common/AbstractS3FileSystemFactory.java | 6 +-
.../flink/fs/s3/common/FlinkS3FileSystem.java | 12 +-
.../writer/RecoverableMultiPartUploadImpl.java | 49 ++--
...3MultiPartUploader.java => S3AccessHelper.java} | 33 ++-
.../flink/fs/s3/common/writer/S3Committer.java | 12 +-
.../S3RecoverableMultipartUploadFactory.java | 53 +----
.../fs/s3/common/writer/S3RecoverableWriter.java | 38 ++-
.../flink/fs/s3/common/S3EntropyFsFactoryTest.java | 4 +-
.../s3/common/writer/IncompletePartPrefixTest.java | 12 +-
.../writer/RecoverableMultiPartUploadImplTest.java | 20 +-
...PartUploader.java => HadoopS3AccessHelper.java} | 64 +++--
.../flink/fs/s3hadoop/S3FileSystemFactory.java | 6 +-
.../s3hadoop/HadoopS3RecoverableWriterITCase.java | 46 ++++
.../flink/fs/s3presto/S3FileSystemFactory.java | 4 +-
.../api/functions/sink/filesystem/Bucket.java | 114 ++++++---
.../functions/sink/filesystem/BulkPartWriter.java | 10 +-
.../functions/sink/filesystem/PartFileWriter.java | 8 +-
.../sink/filesystem/RowWisePartWriter.java | 10 +-
.../api/functions/sink/filesystem/BucketTest.java | 263 +++++++++++++++++++++
22 files changed, 629 insertions(+), 183 deletions(-)
rename
flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/writer/{S3MultiPartUploader.java
=> S3AccessHelper.java} (78%)
rename
flink-filesystems/flink-s3-fs-hadoop/src/main/java/org/apache/flink/fs/s3hadoop/{HadoopS3MultiPartUploader.java
=> HadoopS3AccessHelper.java} (58%)
create mode 100644
flink-streaming-java/src/test/java/org/apache/flink/streaming/api/functions/sink/filesystem/BucketTest.java
