Hi All,

flink-s3-fs-native (the AWS-SDK-v2, Hadoop-free S3 filesystem for s3:// and
s3a://) landed experimentally in Flink 2.3[1]. Since then, the [Phase 2]
Native S3 Filesystem FLINK-39109 [2] has closed 19 subtasks, closing the
feature gap compared to flink-s3-fs-hadoop or flink-s3-fs-presto.

Proposal

1. promote NativeS3FileSystem from Experimental to mainstream in an
upcoming 2.4 release[3]. What is the community view and overall consensus?

2. If you run flink-s3-fs-hadoop or flink-s3-fs-presto in production,
please reply with anything you rely on that flink-s3-fs-native doesn't
cover yet. I've checked all three plugins' sources for the above, but
deployment-specific setups (custom credential providers, particular
S3-compatible endpoints, etc.) may surface gaps I've missed.

Bests,
Samrat

[1]
https://cwiki.apache.org/confluence/spaces/FLINK/pages/396790457/FLIP-555+Flink+Native+S3+FileSystem
[2] https://issues.apache.org/jira/browse/FLINK-39109
[3] https://lists.apache.org/thread/14vym623dh08rry7jsxj2sm6ty4m6cho

Reply via email to