[
https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=566453&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-566453
]
ASF GitHub Bot logged work on HADOOP-13551:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 15/Mar/21 18:31
Start Date: 15/Mar/21 18:31
Worklog Time Spent: 10m
Work Description: steveloughran commented on pull request #2778:
URL: https://github.com/apache/hadoop/pull/2778#issuecomment-799651987
Tested, s3 london, with the new suite to force tests against landsat and
common crawl.
If you comment out the `withForceGlobalBucketAccessEnabled()` change in
DefaultS3ClientFactory the new test suite ITestAWSStatisticCollection fails with
```
org.apache.hadoop.fs.s3a.AWSRedirectException: getObjectMetadata on
s3a://landsat-pds/scene_list.gz:
com.amazonaws.services.s3.model.AmazonS3Exception: The bucket is in this
region: us-west-2. Please use this region to retry the request (Service: Amazon
S3; Status Code: 301; Error Code: 301 Moved Permanently;
```
That is: central endpoint's 301 responses don't trigger a switch to the
endpoint.
Maybe we should include that in troubleshooting
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 566453)
Time Spent: 1h 10m (was: 1h)
> Collect AwsSdkMetrics in S3A FileSystem IOStatistics
> ----------------------------------------------------
>
> Key: HADOOP-13551
> URL: https://issues.apache.org/jira/browse/HADOOP-13551
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.0.0-beta1
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> The S3A Connector has the ability to pass statistics collected by the AWS SDK
> into the IOStatistics store of the (stream, FS)
> But
> * wiring up doesn't (yet) work
> * its best if there was thread-context level collection, though FS-level
> statistics would be a good start.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
