[
https://issues.apache.org/jira/browse/HADOOP-16612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956571#comment-16956571
]
Jeetesh Mangwani commented on HADOOP-16612:
-------------------------------------------
Hi [~DanielZhou],
After syncing with the latest trunk and correcting some of my storage accounts,
most of the errors are gone. However, I still see failures on trunk and my
feature branch as well. I think the failing test will require a separate fix.
Can we address this in a separate PR?
trunk, non-xns
[INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0
[WARNING] Tests run: 395, Failures: 0, Errors: 0, Skipped: 207
[WARNING] Tests run: 192, Failures: 0, Errors: 0, Skipped: 24
=============================================
feature branch, non-xns
[INFO] Tests run: 53, Failures: 0, Errors: 0, Skipped: 0
[WARNING] Tests run: 395, Failures: 0, Errors: 0, Skipped: 207
[WARNING] Tests run: 192, Failures: 0, Errors: 0, Skipped: 24
=============================================
trunk, xns
[INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemCLI>AbstractAbfsIntegrationTest.setup:137 »
AbfsRestOperation
[INFO]
[ERROR] Tests run: 395, Failures: 0, Errors: 1, Skipped: 21
[WARNING] Tests run: 192, Failures: 0, Errors: 0, Skipped: 24
============================================
feature branch, xns
[INFO] Tests run: 53, Failures: 0, Errors: 0, Skipped: 0
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemCLI>AbstractAbfsIntegrationTest.setup:137 »
AbfsRestOperation
[INFO]
[ERROR] Tests run: 395, Failures: 0, Errors: 1, Skipped: 21
[WARNING] Tests run: 192, Failures: 0, Errors: 0, Skipped: 24
Stack trace of the failing test:
[ERROR]
testMkdirRootNonExistentContainer(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCLI)
Time elapsed: 12.776 s <<< ERROR!
Operation failed: "The specified filesystem does not exist.", 404, HEAD,
https://abfstest01.dfs.core.windows.net/abfs-testcontainer-4377d2f0-8f6e-4e0d-8a9a-f35c2f48bac7//?upn=false&action=getAccessControl&timeout=90
at
org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.execute(AbfsRestOperation.java:135)
at
org.apache.hadoop.fs.azurebfs.services.AbfsClient.getAclStatus(AbfsClient.java:516)
at
org.apache.hadoop.fs.azurebfs.services.AbfsClient.getAclStatus(AbfsClient.java:499)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore.getIsNamespaceEnabled(AzureBlobFileSystemStore.java:216)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.getIsNamespaceEnabled(AzureBlobFileSystem.java:1108)
at
org.apache.hadoop.fs.azurebfs.AbstractAbfsIntegrationTest.setup(AbstractAbfsIntegrationTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:748)
> Track Azure Blob File System client-perceived latency
> -----------------------------------------------------
>
> Key: HADOOP-16612
> URL: https://issues.apache.org/jira/browse/HADOOP-16612
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure, hdfs-client
> Reporter: Jeetesh Mangwani
> Assignee: Jeetesh Mangwani
> Priority: Major
>
> Track the end-to-end performance of ADLS Gen 2 REST APIs by measuring latency
> in the Hadoop ABFS driver.
> The latency information is sent back to the ADLS Gen 2 REST API endpoints in
> the subsequent requests.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]