[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17812978#comment-17812978
]
ASF GitHub Bot commented on HADOOP-19050:
-----------------------------------------
adnanhemani commented on code in PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#discussion_r1473617958
##########
hadoop-tools/hadoop-aws/pom.xml:
##########
@@ -508,6 +508,29 @@
<artifactId>bundle</artifactId>
<scope>compile</scope>
</dependency>
+ <dependency>
+ <groupId>software.amazon.s3.accessgrants</groupId>
Review Comment:
This new JAR should be optional - and as per the original instructions the
AWS S3 Access Grants team was given by the AWS Java SDK team, this plugin
should not be part of the AWS Java SDK nor the SDK bundle. The reasoning behind
this was that Java SDKv2 Plugins should be considered as "open source" for the
most part as they are only interfaces that anyone can implement and then use
wherever they'd like. In other words, the S3 Access Grants plugin should be, in
theory, treated as any other open source dependency that we would be utilizing
if a customer explicitly enables this in S3A.
So, to further answer the question, we need to find a way to optionally load
these classes if a user specifies that they'd like to use the plugin AND
provides the JAR on the classpath. That is missing from this PR as of now and
@jxhan3 and I will work on it. I think @ahmarsuhail's link above has a good
call pattern for doing this - we'll follow this unless you have any other
suggestion:
https://github.com/apache/hadoop/pull/6164/files#diff-c76d380f28cd282404a2b7110a6ea76bf2edd7277ed09639a2af594171b07efaR53
One interesting thing to note - I've seen the `S3ExpressPlugin` being merged
into the AWS Java SDK (which was explicitly not the recommended option by the
AWS Java SDK team, per my understanding). I've started further inquiries to
find why that's the case - and how this is different than S3 Access Grants.
Will report my findings here.
> Add S3 Access Grants Support in S3A
> -----------------------------------
>
> Key: HADOOP-19050
> URL: https://issues.apache.org/jira/browse/HADOOP-19050
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Jason Han
> Assignee: Jason Han
> Priority: Minor
> Labels: pull-request-available
>
> Add support for S3 Access Grants
> (https://aws.amazon.com/s3/features/access-grants/) in S3A.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
