[ 
https://issues.apache.org/jira/browse/HADOOP-19083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17827526#comment-17827526
 ] 

Steve Loughran commented on HADOOP-19083:
-----------------------------------------

wondering if actually the way to do this is in the release module with a 
special target there to create a lean tarball the same way we do for arm64; 
take the x86 one and modify it.

That way all jar files will be consistent.

the -DskipShade option is useful in day to day builds as it saves many minutes; 
including the aws sdk into a build just triggers the copy of a single (large!) 
file

> provide hadoop binary tarball without aws v2 sdk
> ------------------------------------------------
>
>                 Key: HADOOP-19083
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19083
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: build, fs/s3
>    Affects Versions: 3.4.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>              Labels: pull-request-available
>
> Have the default hadoop binary .tar.gz exclude the aws v2 sdk by default. 
> This SDK brings the total size of the distribution to about 1 GB.
> Proposed
> * add a profile to include the aws sdk in the dist module
> * disable it by default
> Instead we document which version is needed. 
> The hadoop-aws and hadoop-cloud storage maven artifacts will declare their 
> dependencies, so apps building with those get to do the download.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to