[
https://issues.apache.org/jira/browse/HADOOP-19654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18035358#comment-18035358
]
ASF GitHub Bot commented on HADOOP-19654:
-----------------------------------------
steveloughran commented on PR #7882:
URL: https://github.com/apache/hadoop/pull/7882#issuecomment-3486477634
Seeing
* test timeouts on junit5 + scale + parallel:
https://issues.apache.org/jira/browse/HADOOP-19739
* some failures launching
```
[ERROR] Failures:
[ERROR]
org.apache.hadoop.fs.s3a.commit.integration.ITestS3ACommitterMRJob.test_200_execute
[INFO] Run 1: PASS
[ERROR] Run 2: ITestS3ACommitterMRJob.test_200_execute:342 [Files found in
s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned]
Expecting:
<["s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00001"]>
to be equal to:
<["s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00000",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00001",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00002",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00003",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00004",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00005",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00006",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00007",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00008",
"s3a://stevel-london/job-00-fork-0004/test/ITestS3ACommitterMRJob-execute-partitioned/part-m-00009"]>
but was not.
[INFO] Run 3: PASS
```
This doesn't happen standalone.
In the IDE I get java8 errors, probably need to log out and log in again now
I've switched my default jvm to 17.
I'm not worrying about this.
> Upgrade AWS SDK to 2.35.4
> -------------------------
>
> Key: HADOOP-19654
> URL: https://issues.apache.org/jira/browse/HADOOP-19654
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build, fs/s3
> Affects Versions: 3.5.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> Upgrade to a recent version of 2.33.x or later while off the critical path of
> things.
> HADOOP-19485 froze the sdk at a version which worked with third party stores.
> Apparently the new version works; early tests show that Bulk Delete calls
> with third party stores complain about lack of md5 headers, so some tuning is
> clearly going to be needed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
