steveloughran commented on PR #5706:
URL: https://github.com/apache/hadoop/pull/5706#issuecomment-1573977715
interesting failures...it's where having everyone test in their own config
helps find many config-releated issues
## ITestS3AFileSystemStatistic
```
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
2.393 s <<< FAILURE! - in
org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic
[ERROR]
testBytesReadWithStream(org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic)
Time elapsed: 2.392 s <<< FAILURE!
java.lang.AssertionError: Mismatch in number of FS bytes read by
InputStreams expected:<2048> but was:<69944985>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at
org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic.testBytesReadWithStream(ITestS3AFileSystemStatistic.java:72)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
```
really bizarre that one, as we are doing two full reads of 1 KB file.
if it keeps happening, when you do a standalone test run, it'd be
interesting to see the whole debug level logs which will be collected under
target/ somewhere.
## ITestS3ATemporaryCredentials
looks like it needs to be something which can be disabled, maybe by setting
the endpoint to something special like "none". why not create a new JIRA for
that for you to work on later...
## ITestStagingCommitProtocolFailure
that shouldn't happen; as it looks like a setup expecting a failure is now
passing. Probably needs fixing in the test, but we need to understand why the
test is failing first.
this is the one which needs attention.
```
org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocolFailure
[ERROR]
testCreateCommitter(org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocolFailure)
Time elapsed: 0.97 s <<< FAILURE!
java.lang.AssertionError: Expected a
org.apache.hadoop.fs.s3a.commit.PathCommitException to be thrown, but got the
result: : StagingCommitter{AbstractS3ACommitter{role=Task committer
attempt__0000_r_000000_0, name=staging,
outputPath=s3a://hadoop-test-s3a-li/test/testCreateCommitter,
workPath=file:/Users/mhewasinghage/Liveintent/repo/hadoop-fork/hadoop-tools/hadoop-aws/target/build/test/job__0000-attempt__0000_r_000000_0/_temporary/0/_temporary/attempt__0000_r_000000_0,
uuid='job__0000', uuid source=JobUUIDSource{text='JobID'}},
commitsDirectory=file:/Users/mhewasinghage/Liveintent/repo/hadoop-fork/hadoop-tools/hadoop-aws/tmp/staging/mhewasinghage/job__0000/staging-uploads,
uniqueFilenames=true, conflictResolution=APPEND, uploadPartSize=67108864,
wrappedCommitter=FileOutputCommitter{PathOutputCommitter{context=TaskAttemptContextImpl{JobContextImpl{jobId=job__0000};
taskId=attempt__0000_r_000000_0, status=''};
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter@36e80411}; ou
tputPath=file:/Users/mhewasinghage/Liveintent/repo/hadoop-fork/hadoop-tools/hadoop-aws/tmp/staging/mhewasinghage/job__0000/staging-uploads,
workPath=null, algorithmVersion=1, skipCleanup=false,
ignoreCleanupFailures=false}}
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:499)
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:384)
at
org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocolFailure.testCreateCommitter(ITestStagingCommitProtocolFailure.java:66)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
