[
https://issues.apache.org/jira/browse/FLINK-39560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18078264#comment-18078264
]
Samrat Deb commented on FLINK-39560:
------------------------------------
HI [~howlotus]
Thank you for the proposal. This would be a great addition for native S3 FS.
Currently, the focus is to make the core for flink<>s3 rock solid.
the major key area
1. core implementation must not have data integrity issue
2. Better performance and code extensibility so that new features are easy to
add in future
3. Ensure better usability and at par with flink-s3-fs-hadoop so that we can
slowly deprecate flink-s3-fs-hadoop and make native-s3-fs sole offering for
flink<>s3.
Thank you
> [PROPOSAL] Allow custom, pre-configured AWS S3 clients to be injected into
> new Native S3 filesystem
> ---------------------------------------------------------------------------------------------------
>
> Key: FLINK-39560
> URL: https://issues.apache.org/jira/browse/FLINK-39560
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / State Backends
> Affects Versions: 2.3.0
> Reporter: Badma Ochirov
> Priority: Major
>
> *Current behavior:*
> Incoming release-2.3 provides new Native S3 File System with AWS S3 v2
> support. Filesystem constructs its internal _S3Client_ and _S3AsyncClient_
> directly within the filesystem implementation.
> *Proposed Improvement:*
> I would like to propose an enhancement to allow users to inject externally
> created and pre-configured instances of {_}S3Client{_}, _S3AsyncClient_ into
> the Native S3 File System.
> The change should be fully backward compatible. If no custom factory or
> clients are provided, the filesystem should behave exactly as it does now.
> This is valuable in environments where:
> # The application already manages AWS SDK client lifecycle (e.g., for other
> services).
> # There are strict architectural or security requirements to use a specific,
> centrally configured client (e.g., with custom interceptors, metrics,
> tracing, or credential resolution chains).
> # It simplifies configuration by reusing existing client factories or
> dependency injection contexts.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
