This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from b0d1d33 [FLINK-11044] [docs] Fix registerTableSink docs
new 0c1328a [hotfix][fs-connector] Refactor PartFileWriter to take stream.
new 7dc8e69 [hotfix][fs-connector] Refactor Bucket to statically import
Preconditions.
new 0c791cf [hotfix][s3-connector] Renamed S3MultiPartUploader to
S3AccessHelper.
new cf79300 [hotfix] Consolidated all S3 accesses under the
S3AccessHelper.
new 153ca54 [hotfix] Method renaming in the
RecoverableMultiPartUploadImpl.
new bf5dc6c [FLINK-10963][fs-connector, s3] Cleanup tmp S3 objects
uploaded as backups of in-progress files.
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../apache/flink/core/fs/RecoverableWriter.java | 28 +++
.../core/fs/local/LocalRecoverableWriter.java | 10 +
.../runtime/fs/hdfs/HadoopRecoverableWriter.java | 10 +
.../fs/s3/common/AbstractS3FileSystemFactory.java | 6 +-
.../flink/fs/s3/common/FlinkS3FileSystem.java | 12 +-
.../writer/RecoverableMultiPartUploadImpl.java | 49 ++--
...3MultiPartUploader.java => S3AccessHelper.java} | 33 ++-
.../flink/fs/s3/common/writer/S3Committer.java | 12 +-
.../S3RecoverableMultipartUploadFactory.java | 53 +----
.../fs/s3/common/writer/S3RecoverableWriter.java | 38 ++-
.../flink/fs/s3/common/S3EntropyFsFactoryTest.java | 4 +-
.../s3/common/writer/IncompletePartPrefixTest.java | 12 +-
.../writer/RecoverableMultiPartUploadImplTest.java | 20 +-
...PartUploader.java => HadoopS3AccessHelper.java} | 64 +++--
.../flink/fs/s3hadoop/S3FileSystemFactory.java | 6 +-
.../s3hadoop/HadoopS3RecoverableWriterITCase.java | 46 ++++
.../flink/fs/s3presto/S3FileSystemFactory.java | 4 +-
.../api/functions/sink/filesystem/Bucket.java | 114 ++++++---
.../functions/sink/filesystem/BulkPartWriter.java | 10 +-
.../functions/sink/filesystem/PartFileWriter.java | 8 +-
.../sink/filesystem/RowWisePartWriter.java | 10 +-
.../api/functions/sink/filesystem/BucketTest.java | 263 +++++++++++++++++++++
22 files changed, 629 insertions(+), 183 deletions(-)
rename
flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/writer/{S3MultiPartUploader.java
=> S3AccessHelper.java} (78%)
rename
flink-filesystems/flink-s3-fs-hadoop/src/main/java/org/apache/flink/fs/s3hadoop/{HadoopS3MultiPartUploader.java
=> HadoopS3AccessHelper.java} (58%)
create mode 100644
flink-streaming-java/src/test/java/org/apache/flink/streaming/api/functions/sink/filesystem/BucketTest.java
