[
https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875195#comment-16875195
]
Mingliang Liu commented on HADOOP-15076:
----------------------------------------
Thanks Steve! I plan to create an uber JIRA to include backports to
{{branch-2}}. AFAIK, HBase will be on Hadoop 2.x for a while; curation
{{branch-2}} hopefully will help HBase on S3 use case.
{quote}
seems like the latest AWS SDKs (the one on trunk at least) does a HEAD to
determine endpoint and switches the default signing to v4, so it's transparent.
{quote}
I'm on Hadoop 2.9.2 and the AWS SDK version is 1.11.199. When I do a simple
{{hadoop fs -cat s3a://eks-hbase-rootdir-ming/mingliang/hbase.version}}
request, I can see logs showing {{AWS4 String to Sign: '"AWS4-HMAC-SHA256}}. I
assume this v4 auth is there in {{branch-2}}.
> Enhance S3A troubleshooting documents and add a performance document
> --------------------------------------------------------------------
>
> Key: HADOOP-15076
> URL: https://issues.apache.org/jira/browse/HADOOP-15076
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: documentation, fs/s3
> Affects Versions: 2.8.2
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Blocker
> Fix For: 3.1.0
>
> Attachments: HADOOP-15076-001.patch, HADOOP-15076-002.patch,
> HADOOP-15076-003.patch, HADOOP-15076-004.patch, HADOOP-15076-005.patch,
> HADOOP-15076-006.patch
>
>
> A recurrent theme in s3a-related JIRAs, support calls etc is "tried upgrading
> the AWS SDK JAR and then I got the error ...". We know here "don't do that",
> but its not something immediately obvious to lots of downstream users who
> want to be able to drop in the new JAR to fix things/add new features
> We need to spell this out quite clearlyi "you cannot safely expect to do
> this. If you want to upgrade the SDK, you will need to rebuild the whole of
> hadoop-aws with the maven POM updated to the latest version, ideally
> rerunning all the tests to make sure something hasn't broken.
> Maybe near the top of the index.md file, along with "never share your AWS
> credentials with anyone"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
