[
https://issues.apache.org/jira/browse/HADOOP-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357561#comment-15357561
]
Steve Loughran commented on HADOOP-13334:
-----------------------------------------
{code}
org.apache.hadoop.fs.s3a.AWSS3IOException: getFileStatus on
s3a://landsat-pds/scene_list.gz:
com.amazonaws.services.s3.model.AmazonS3Exception: Moved Permanently (Service:
Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID:
68FA0CDF257E8E88), S3 Extended Request ID:
ZrrcD+fiQ/H3B945SNuLm69beK1rfa/CcL0Zwg6QN+837odqsH067OM2ctBZ8qRlaUqnQ3brl7U=:
Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved
Permanently; Request ID: 68FA0CDF257E8E88)
at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:127)
at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:69)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1459)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:113)
at org.apache.hadoop.fs.Globber.getFileStatus(Globber.java:64)
at org.apache.hadoop.fs.Globber.doGlob(Globber.java:269)
at org.apache.hadoop.fs.Globber.glob(Globber.java:148)
at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1697)
at org.apache.hadoop.fs.s3a.S3AFileSystem.globStatus(S3AFileSystem.java:1912)
at
org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:266)
...
Cause: com.amazonaws.services.s3.model.AmazonS3Exception: Moved Permanently
(Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently;
Request ID: 68FA0CDF257E8E88)
at
com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.java:1182)
at
com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:770)
at
com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785)
at
com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050)
at
com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:925)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1444)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:113)
...
{code}
> AmazonClient 30x exceptions to include redirect URL in message
> --------------------------------------------------------------
>
> Key: HADOOP-13334
> URL: https://issues.apache.org/jira/browse/HADOOP-13334
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Steve Loughran
> Priority: Minor
>
> It'd be easier to work out what's happening when s3a calls against different
> endpoints fail if the 301 exceptions forwarded up included the URL in the
> header which (presumably) says where things moved to
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
