[ 
https://issues.apache.org/jira/browse/HADOOP-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933432#comment-17933432
 ] 

ASF GitHub Bot commented on HADOOP-19282:
-----------------------------------------

LDVSOFT opened a new pull request, #7483:
URL: https://github.com/apache/hadoop/pull/7483

   ### Description of PR
   
   `URIBuilder` was used from the AWS SDK for Java v2, to be precise from the 
shaded Apache HTTP Client. It is a problem if a user would like not to use the 
AWS SDK bundle, since more or less only 3 modules are needed (s3, s3-transfer & 
sts), but that may cause problems on unshaded dependency versions. Since a URI 
constructor can achieve the same here I switched it as a preferred option.
   
   ### How was this patch tested?
   
   I've run [the test 
suite](https://hadoop.apache.org/docs/r3.4.1/hadoop-aws/tools/hadoop-aws/testing.html)
 against a _eu-west-1_ bucket, without scaling/load since the change shouldn't 
affect that. To be exact, with something like this:
   <details>
     <summary><code class="notranslate">auth-keys.xml</code></summary>
   
       <configuration>
       <property>
           <name>test.fs.s3a.name</name>
           <value>s3a://hadoop-test-‹edited›</value>
       </property>
   
       <property>
           <name>test.fs.s3a.encryption.enabled</name>
           <value>false</value>
           <description>Don't wanna</description>
       </property>
   
       <property>
           <name>test.fs.s3a.create.acl.enabled</name>
           <value>false</value>
           <description>disabled on server</description>
       </property>
   
       <property>
           <name>fs.s3a.endpoint.region</name>
           <value>eu-west-1</value>
       </property>
   
       <property>
           <name>fs.s3a.assumed.role.sts.endpoint.region</name>
           <value>eu-west-1</value>
       </property>
   
       <property>
           <name>test.sts.endpoint</name>
           <description>Specific endpoint to use for STS requests.</description>
           <value>sts.eu-west-1.amazonaws.com</value>
       </property>
   
       <property>
           <name>fs.s3a.assumed.role.sts.endpoint</name>
           <value>${test.sts.endpoint}</value>
       </property>
   
       <property>
           <name>fs.contract.test.fs.s3a</name>
           <value>${test.fs.s3a.name}</value>
       </property>
   
       <property>
           <!

> S3A: STSClientFactory has hard-coded dependency on shaded HttpClient
> --------------------------------------------------------------------
>
>                 Key: HADOOP-19282
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19282
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: melin
>            Priority: Major
>
> hadoop-aws directly depends on aws-java-sdk-bundle, and the size of 
> aws-java-sdk-bundle is too large. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to