[
https://issues.apache.org/jira/browse/HADOOP-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792061#comment-16792061
]
Steve Loughran commented on HADOOP-16188:
-----------------------------------------
{code}
dest/.hive-staging_hive_2019-03-11_05-50-13_382_7297996996718911643-1/_tmp.-ext-10000/ym=201901/001203_0:
com.amazonaws.SdkClientException: Unable to copy part: We encountered an
internal error. Please try again. (Service: Amazon S3; Status Code: 200; Error
Code: InternalError; Request ID: 2B0F6CD699E1D9F6): Unable to copy part: We
encountered an internal error. Please try again. (Service: Amazon S3; Status
Code: 200; Error Code: InternalError; Request ID: 2B0F6CD699E1D9F6)
at
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:147)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.copyFile(S3AFileSystem.java:2198)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.innerRename(S3AFileSystem.java:915)
at org.apache.hadoop.fs.s3a.S3AFileSystem.rename(S3AFileSystem.java:746)
at
org.apache.hadoop.hive.ql.util.ParallelDirectoryRenamer$1.call(ParallelDirectoryRenamer.java:105)
at
org.apache.hadoop.hive.ql.util.ParallelDirectoryRenamer$1.call(ParallelDirectoryRenamer.java:101)
... 4 more
Caused by: com.amazonaws.SdkClientException: Unable to copy part: We
encountered an internal error. Please try again. (Service: Amazon S3; Status
Code: 200; Error Code: InternalError; Request ID: 2B0F6CD699E1D9F6)
at
com.amazonaws.services.s3.transfer.internal.CompleteMultipartCopy.collectPartETags(CompleteMultipartCopy.java:117)
at
com.amazonaws.services.s3.transfer.internal.CompleteMultipartCopy.call(CompleteMultipartCopy.java:79)
at
com.amazonaws.services.s3.transfer.internal.CompleteMultipartCopy.call(CompleteMultipartCopy.java:38)
... 4 more
Caused by: com.amazonaws.services.s3.model.AmazonS3Exception: We encountered an
internal error. Please try again. (Service: Amazon S3; Status Code: 200; Error
Code: InternalError; Request ID: 2B0F6CD699E1D9F6), S3 Extended Request ID:
9KWB8D2Tqo27t/5BdpRwrKZ68YdYNLDKuNUHag/jux28rjnxsCOM2/HI38odKBN5/m3R7lzO09Y=
at
com.amazonaws.services.s3.AmazonS3Client.copyPart(AmazonS3Client.java:2024)
at
com.amazonaws.services.s3.transfer.internal.CopyPartCallable.call(CopyPartCallable.java:41)
at
com.amazonaws.services.s3.transfer.internal.CopyPartCallable.call(CopyPartCallable.java:28)
{code}
> s3a rename failed during copy, "Unable to copy part" + 200 error code
> ---------------------------------------------------------------------
>
> Key: HADOOP-16188
> URL: https://issues.apache.org/jira/browse/HADOOP-16188
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.2.0
> Reporter: Steve Loughran
> Priority: Minor
>
> Error during a rename where AWS S3 seems to have some internal error *which
> is not retried and returns status code 200"
> {code}
> com.amazonaws.SdkClientException: Unable to copy part: We encountered an
> internal error. Please try again. (Service: Amazon S3; Status Code: 200;
> Error Code: InternalError;
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
