[
https://issues.apache.org/jira/browse/HADOOP-17471?focusedWorklogId=588240&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-588240
]
ASF GitHub Bot logged work on HADOOP-17471:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 24/Apr/21 03:17
Start Date: 24/Apr/21 03:17
Worklog Time Spent: 10m
Work Description: mehakmeet commented on pull request #2950:
URL: https://github.com/apache/hadoop/pull/2950#issuecomment-826025696
Tested using: mvn -T 16 -Dparallel-tests=abfs clean verify
Region: East US
```
[ERROR] Errors:
[ERROR]
ITestAbfsFileSystemContractDistCp>AbstractContractDistCpTest.testDistCpWithIterator:631
» TestTimedOut
[INFO]
[ERROR] Tests run: 260, Failures: 0, Errors: 1, Skipped: 79
```
Got a fairly consistent Timeout error also seen in base.
```
[ERROR] Errors:
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testCheckAccessForNonExistentFile »
Unexp...
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionALL:293->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionEXECUTE:218->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionNONE:204->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionREAD:233->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionREADEXECUTE:263->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionWRITE:248->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionWRITEEXECUTE:278->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
[INFO]
[ERROR] Tests run: 526, Failures: 0, Errors: 8, Skipped: 67
```
IllegalArgument failures due to no configs for OAuth.
One more error that I see intermittently on mvn is:
```
[ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.71
s <<< FAILURE! - in
org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException
[ERROR]
testCustomTokenFetchRetryCount(org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException)
Time elapsed: 1.22 s <<< FAILURE!
java.lang.AssertionError: Number of token fetch retries (4) done, does not
match with fs.azure.custom.token.fetch.retry.count configured (0)
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at
org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException.testWithDifferentCustomTokenFetchRetry(ITestAbfsRestOperationException.java:122)
at
org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException.testCustomTokenFetchRetryCount(ITestAbfsRestOperationException.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:288)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:282)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:748)
```
I never see this in IDE so wasn't able to debug. I see this same error in
branch-3.3 so this is not due to my changes. Don't see it in trunk as well. One
weird thing to note here is when I use ```mvn -X``` to see debug logs for this
test, it never fails. Don't know if this is a known issue or not.
CC: @steveloughran
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 588240)
Time Spent: 2h 50m (was: 2h 40m)
> ABFS to collect IOStatistics
> ----------------------------
>
> Key: HADOOP-17471
> URL: https://issues.apache.org/jira/browse/HADOOP-17471
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Reporter: Steve Loughran
> Assignee: Mehakmeet Singh
> Priority: Major
> Labels: pull-request-available
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> Add stats collection to ABFS FS operations, especially
> * create
> * open
> * delete
> * rename
> * getFilesStatus
> * list
> * attribute get/set
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
