[
https://issues.apache.org/jira/browse/HADOOP-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-14204:
------------------------------------
Attachment: HADOOP-14204-branch-2.8-001.patch
Patch 001; create a new, sortable list. This is what the later AWS sdk does
internally, it is mostly harmless on those SDKs, and should prevent the problem
on the version in Hadoop 2.7-2.8.
Testing: s3a frankfurt, also rebuilt spark & ran the tests downstream, as that
was where I saw it. No occurrences in repeated test runs.
> S3A multipart commit failing, "UnsupportedOperationException at
> java.util.Collections$UnmodifiableList.sort"
> ------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-14204
> URL: https://issues.apache.org/jira/browse/HADOOP-14204
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/s3
> Affects Versions: 2.8.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Critical
> Attachments: HADOOP-14204-branch-2.8-001.patch
>
>
> Stack trace seen trying to commit a multipart upload, as the EMR code (which
> takes a {{List<String> etags}} is trying to sort that list directly, which it
> can't do if the list doesn't want to be sorted.
> later versions of the SDK clone the list before sorting.
> We need to make sure that the list passed in can be sorted.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
