CLevasseur commented on PR #4262:
URL: https://github.com/apache/hadoop/pull/4262#issuecomment-1406479958
Hi, sorry for the delay, it took me a while to set everything up.
Unfortunately I am still getting issues when running the integration tests on
the `apache/hadoop` repo (i'm not even using my fork at this point).
It looks like permission issues, although the roles look correct to me. I
followed the doc asking for:
```
3. A Service principal with RBAC - Storage Blob Data Owner (superuser) role
on account
4. A Service principal with no RBAC roles assigned on account. This is
needed for checkaccess tests (noRBACUser)
5. A Service principal with Storage Blob Data Contributor RBAC roles
assigned on account. This is needed for RBAC tests (contributorRBACUser)
6. A Service principal with Storage Blob Data Reader RBAC roles assigned on
account. This is needed for RBAC tests (readerRBACUser)
```
The credentials of each of these 4 account was set in the configuration file.
Here is the output of running the HNS-OAuth test suite, can you tell me if
those failures are expected, and if not, what I might miss ?
```
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAbfsStatistics
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAbfsErrorTranslation
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAccountConfiguration
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAbfsCrc64
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestAbfsPerfTracker
[INFO] Running
org.apache.hadoop.fs.azurebfs.services.TestExponentialRetryPolicy
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestAbfsInputStream
[INFO] Running
org.apache.hadoop.fs.azurebfs.services.TestAbfsRenameRetryRecovery
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.392
s - in org.apache.hadoop.fs.azurebfs.TestAbfsCrc64
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.225
s - in org.apache.hadoop.fs.azurebfs.TestAbfsErrorTranslation
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestQueryParams
[ERROR] Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
3.192 s <<< FAILURE! - in org.apache.hadoop.fs.azurebfs.TestAccountConfiguration
[ERROR]
testConfigPropNotFound(org.apache.hadoop.fs.azurebfs.TestAccountConfiguration)
Time elapsed: 0.19 s <<< FAILURE!
java.lang.AssertionError: Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:499)
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:384)
at
org.apache.hadoop.fs.azurebfs.TestAccountConfiguration.testMissingConfigKey(TestAccountConfiguration.java:399)
at
org.apache.hadoop.fs.azurebfs.TestAccountConfiguration.testConfigPropNotFound(TestAccountConfiguration.java:386)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.404
s - in org.apache.hadoop.fs.azurebfs.services.TestQueryParams
[INFO] Running
org.apache.hadoop.fs.azurebfs.services.TestAzureADAuthenticator
[INFO] Running
org.apache.hadoop.fs.azurebfs.services.TestTextFileBasedIdentityHandler
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestAbfsOutputStream
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.809
s - in org.apache.hadoop.fs.azurebfs.TestAbfsStatistics
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.516
s - in org.apache.hadoop.fs.azurebfs.services.TestTextFileBasedIdentityHandler
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestAbfsClient
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestAbfsHttpOperation
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.182
s - in org.apache.hadoop.fs.azurebfs.services.TestAbfsRenameRetryRecovery
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.515
s - in org.apache.hadoop.fs.azurebfs.services.TestAbfsHttpOperation
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
10.529 s - in org.apache.hadoop.fs.azurebfs.services.TestAbfsPerfTracker
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.637
s - in org.apache.hadoop.fs.azurebfs.services.TestAzureADAuthenticator
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.092
s - in org.apache.hadoop.fs.azurebfs.services.TestAbfsClient
[INFO] Running
org.apache.hadoop.fs.azurebfs.services.TestAbfsClientThrottlingAnalyzer
[INFO] Running
org.apache.hadoop.fs.azurebfs.services.TestShellDecryptionKeyProvider
[INFO] Running
org.apache.hadoop.fs.azurebfs.TestAbfsConfigurationFieldsValidation
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.458
s - in org.apache.hadoop.fs.azurebfs.services.TestShellDecryptionKeyProvider
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAbfsInputStreamStatistics
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAbfsOutputStreamStatistics
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.03
s - in org.apache.hadoop.fs.azurebfs.TestAbfsConfigurationFieldsValidation
[INFO] Running
org.apache.hadoop.fs.azurebfs.diagnostics.TestConfigurationValidators
[INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
0.263 s - in
org.apache.hadoop.fs.azurebfs.diagnostics.TestConfigurationValidators
[INFO] Running
org.apache.hadoop.fs.azurebfs.extensions.TestDTManagerLifecycle
[INFO] Running
org.apache.hadoop.fs.azurebfs.extensions.TestCustomOauthTokenProvider
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.304
s - in org.apache.hadoop.fs.azurebfs.TestAbfsInputStreamStatistics
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.894
s - in org.apache.hadoop.fs.azurebfs.services.TestAbfsOutputStream
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.627
s - in org.apache.hadoop.fs.azurebfs.extensions.TestDTManagerLifecycle
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.953
s - in org.apache.hadoop.fs.azurebfs.extensions.TestCustomOauthTokenProvider
[INFO] Running org.apache.hadoop.fs.azurebfs.utils.TestUriUtils
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.236
s - in org.apache.hadoop.fs.azurebfs.TestAbfsOutputStreamStatistics
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.319
s - in org.apache.hadoop.fs.azurebfs.utils.TestUriUtils
[INFO] Running org.apache.hadoop.fs.azurebfs.utils.TestCachedSASToken
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAbfsNetworkStatistics
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.355
s - in org.apache.hadoop.fs.azurebfs.utils.TestCachedSASToken
[INFO] Running org.apache.hadoop.fs.azurebfs.TestTracingContext
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.834
s - in org.apache.hadoop.fs.azurebfs.TestAbfsNetworkStatistics
[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
3.102 s - in org.apache.hadoop.fs.azurebfs.TestTracingContext
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
36.466 s - in
org.apache.hadoop.fs.azurebfs.services.TestAbfsClientThrottlingAnalyzer
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
59.788 s - in org.apache.hadoop.fs.azurebfs.services.TestAbfsInputStream
[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 2, Time elapsed:
99.715 s - in org.apache.hadoop.fs.azurebfs.services.TestExponentialRetryPolicy
[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[INFO]
[ERROR] Tests run: 111, Failures: 1, Errors: 0, Skipped: 3
[INFO]
[ERROR] There are test failures.
Please refer to /hadoop/hadoop-tools/hadoop-azure/target/surefire-reports
for the individual test results.
Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump
and [date].dumpstream.
[INFO]
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-azure ---
[INFO]
[INFO] --- maven-jar-plugin:2.5:test-jar (default) @ hadoop-azure ---
[INFO] Building jar:
/hadoop/hadoop-tools/hadoop-azure/target/hadoop-azure-3.4.0-SNAPSHOT-tests.jar
[INFO]
[INFO] --- maven-site-plugin:3.11.0:attach-descriptor (attach-descriptor) @
hadoop-azure ---
[INFO] Skipping because packaging 'jar' is not pom.
[INFO]
[INFO] --- cyclonedx-maven-plugin:2.7.3:makeBom (default) @ hadoop-azure ---
[INFO] CycloneDX: Parameters
[INFO]
------------------------------------------------------------------------
[INFO] schemaVersion : 1.4
[INFO] includeBomSerialNumber : true
[INFO] includeCompileScope : true
[INFO] includeProvidedScope : true
[INFO] includeRuntimeScope : true
[INFO] includeTestScope : false
[INFO] includeSystemScope : true
[INFO] includeLicenseText : false
[INFO] outputReactorProjects : true
[INFO] outputFormat : all
[INFO] outputName : bom
[INFO]
------------------------------------------------------------------------
[INFO] CycloneDX: Resolving Dependencies
[INFO] CycloneDX: Creating BOM
[INFO] CycloneDX: Writing BOM (XML):
/hadoop/hadoop-tools/hadoop-azure/target/bom.xml
[INFO] CycloneDX: Validating BOM (XML):
/hadoop/hadoop-tools/hadoop-azure/target/bom.xml
[INFO] CycloneDX: Writing BOM (JSON):
/hadoop/hadoop-tools/hadoop-azure/target/bom.json
[INFO] CycloneDX: Validating BOM (JSON):
/hadoop/hadoop-tools/hadoop-azure/target/bom.json
[WARNING] Unknown keyword additionalItems - you should define your own Meta
Schema. If the keyword is irrelevant for validation, just use a
NonValidationKeyword
[INFO]
[INFO] --- maven-failsafe-plugin:3.0.0-M1:integration-test
(integration-test-abfs-parallel-classesAndMethods) @ hadoop-azure ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemFileStatus
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.066
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemFileStatus
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestSharedKeyAuth
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
0.615 s - in org.apache.hadoop.fs.azurebfs.ITestSharedKeyAuth
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestOauthOverAbfsScheme
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.291
s - in org.apache.hadoop.fs.azurebfs.ITestOauthOverAbfsScheme
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCLI
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.38
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCLI
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsStatistics
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
12.184 s - in org.apache.hadoop.fs.azurebfs.ITestAbfsStatistics
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemAppend
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.445
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemAppend
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsHugeFiles
[INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
12.457 s - in org.apache.hadoop.fs.azurebfs.ITestAbfsHugeFiles
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsNetworkStatistics
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.489
s - in org.apache.hadoop.fs.azurebfs.ITestAbfsNetworkStatistics
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemFinalize
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.99
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemFinalize
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemOauth
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.77
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemOauth
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemInitAndCreate
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.414
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemInitAndCreate
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCreate
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.598
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCreate
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemMainOperation
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemStoreListStatusWithRange
[INFO] Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
19.689 s - in
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemMainOperation
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.372
s - in
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemStoreListStatusWithRange
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestWasbAbfsCompatibility
[WARNING] Tests run: 5, Failures: 0, Errors: 0, Skipped: 4, Time elapsed:
1.001 s - in org.apache.hadoop.fs.azurebfs.ITestWasbAbfsCompatibility
[INFO] Running org.apache.hadoop.fs.azurebfs.services.ITestAbfsUnbuffer
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.873
s - in org.apache.hadoop.fs.azurebfs.services.ITestAbfsUnbuffer
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemRenameUnicode
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.19
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemRenameUnicode
[INFO] Running org.apache.hadoop.fs.azurebfs.services.ITestAbfsOutputStream
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.144
s - in org.apache.hadoop.fs.azurebfs.services.ITestAbfsOutputStream
[INFO] Running org.apache.hadoop.fs.azurebfs.services.ITestAbfsPositionedRead
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.692
s - in org.apache.hadoop.fs.azurebfs.services.ITestAbfsPositionedRead
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemRename
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
15.391 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemRename
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFilesystemAcl
[WARNING] Tests run: 66, Failures: 0, Errors: 0, Skipped: 9, Time elapsed:
10.094 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFilesystemAcl
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemBackCompat
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
0.707 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemBackCompat
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCopy
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.933
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCopy
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestClientUrlScheme
[WARNING] Tests run: 4, Failures: 0, Errors: 0, Skipped: 4, Time elapsed:
0.419 s - in org.apache.hadoop.fs.azurebfs.ITestClientUrlScheme
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemRandomRead
[WARNING] Tests run: 10, Failures: 0, Errors: 0, Skipped: 2, Time elapsed:
5.866 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemRandomRead
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsIdentityTransformer
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.084
s - in org.apache.hadoop.fs.azurebfs.ITestAbfsIdentityTransformer
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemE2E
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.978
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemE2E
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemMkDir
[WARNING] Tests run: 5, Failures: 0, Errors: 0, Skipped: 2, Time elapsed:
2.116 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemMkDir
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemFlush
[INFO] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
31.784 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemFlush
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsMsiTokenProvider
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemPermission
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
0.319 s - in org.apache.hadoop.fs.azurebfs.ITestAbfsMsiTokenProvider
[INFO] Tests run: 128, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
8.366 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemPermission
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAbfsListStatusRemoteIterator
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemAttributes
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.988
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemAttributes
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsInputStreamStatistics
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.248
s - in org.apache.hadoop.fs.azurebfs.ITestAbfsInputStreamStatistics
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
20.267 s - in org.apache.hadoop.fs.azurebfs.ITestAbfsListStatusRemoteIterator
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestFileSystemProperties
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.015
s - in org.apache.hadoop.fs.azurebfs.ITestFileSystemProperties
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestFileSystemRegistration
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.557
s - in org.apache.hadoop.fs.azurebfs.ITestFileSystemRegistration
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.521
s - in org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestCustomerProvidedKey
[WARNING] Tests run: 28, Failures: 0, Errors: 0, Skipped: 28, Time elapsed:
0.769 s - in org.apache.hadoop.fs.azurebfs.ITestCustomerProvidedKey
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess
[ERROR] Tests run: 12, Failures: 6, Errors: 1, Skipped: 1, Time elapsed:
2.714 s <<< FAILURE! - in
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess
[ERROR]
testFsActionWRITE(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess)
Time elapsed: 2.111 s <<< FAILURE!
java.lang.AssertionError: Should have been given access WRITE on
abfss://abfs-testcontainer-4d803dd2-6863-4838-b9d2-45a8b4f5f...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFolder55f27a0ad7c1/test5.txt
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.assertAccessible(ITestAzureBlobFileSystemCheckAccess.java:326)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.testFsActionWRITE(ITestAzureBlobFileSystemCheckAccess.java:252)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
[ERROR]
testFsActionREAD(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess)
Time elapsed: 2.082 s <<< FAILURE!
java.lang.AssertionError: Should have been given access READ on
abfss://abfs-testcontainer-f32659ec-61fb-4ec3-865b-4dbbb4c95...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFolderf131b527a2a5/test4.txt
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.assertAccessible(ITestAzureBlobFileSystemCheckAccess.java:326)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.testFsActionREAD(ITestAzureBlobFileSystemCheckAccess.java:237)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
[ERROR]
testCheckAccessForNonExistentFile(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess)
Time elapsed: 1.914 s <<< ERROR!
java.lang.Exception: Unexpected exception,
expected<java.io.FileNotFoundException> but
was<org.apache.hadoop.security.AccessControlException>
at
org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:30)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.hadoop.security.AccessControlException: Operation
failed: "This request is not authorized to perform this operation using this
permission.", 403, HEAD,
https://hadoopazuretests.dfs.core.windows.net/abfs-testcontainer-4a2b1026-c6c5-4e89-9f12-1e78c6161dd1/fork-0005/test/CheckAccessTestFolder6b7a4c22ebc4/nonExistentFile1.txt?action=checkAccess&fsAction=r--&timeout=90
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.checkCheckAccessException(AzureBlobFileSystem.java:1449)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.access(AzureBlobFileSystem.java:1267)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.testCheckAccessForNonExistentFile(ITestAzureBlobFileSystemCheckAccess.java:131)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:19)
... 7 more
Caused by: Operation failed: "This request is not authorized to perform this
operation using this permission.", 403, HEAD,
https://hadoopazuretests.dfs.core.windows.net/abfs-testcontainer-4a2b1026-c6c5-4e89-9f12-1e78c6161dd1/fork-0005/test/CheckAccessTestFolder6b7a4c22ebc4/nonExistentFile1.txt?action=checkAccess&fsAction=r--&timeout=90
at
org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.completeExecute(AbfsRestOperation.java:234)
at
org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.lambda$execute$0(AbfsRestOperation.java:194)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.measureDurationOfInvocation(IOStatisticsBinding.java:494)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.trackDurationOfInvocation(IOStatisticsBinding.java:465)
at
org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.execute(AbfsRestOperation.java:192)
at
org.apache.hadoop.fs.azurebfs.services.AbfsClient.checkAccess(AbfsClient.java:1076)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore.access(AzureBlobFileSystemStore.java:1548)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.access(AzureBlobFileSystem.java:1265)
... 17 more
[ERROR]
testFsActionEXECUTE(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess)
Time elapsed: 1.88 s <<< FAILURE!
java.lang.AssertionError: Should have been given access EXECUTE on
abfss://abfs-testcontainer-0f7bb879-469d-499c-9949-c12f8a29e...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFoldereec6282e78a9/test3.txt
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.assertAccessible(ITestAzureBlobFileSystemCheckAccess.java:326)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.testFsActionEXECUTE(ITestAzureBlobFileSystemCheckAccess.java:222)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
[ERROR]
testFsActionREADEXECUTE(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess)
Time elapsed: 1.647 s <<< FAILURE!
java.lang.AssertionError: Should have been given access EXECUTE on
abfss://abfs-testcontainer-c6593d53-53af-472f-87b3-3aebcf49a...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFoldere8852e291d68/test6.txt
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.assertAccessible(ITestAzureBlobFileSystemCheckAccess.java:326)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.testFsActionREADEXECUTE(ITestAzureBlobFileSystemCheckAccess.java:267)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
[ERROR]
testFsActionWRITEEXECUTE(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess)
Time elapsed: 2.182 s <<< FAILURE!
java.lang.AssertionError: Should have been given access EXECUTE on
abfss://abfs-testcontainer-423cd975-0340-4eed-b96b-6e2dee420...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFolderc7c7a77c8539/test7.txt
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.assertAccessible(ITestAzureBlobFileSystemCheckAccess.java:326)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.testFsActionWRITEEXECUTE(ITestAzureBlobFileSystemCheckAccess.java:282)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
[ERROR]
testFsActionALL(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess)
Time elapsed: 1.887 s <<< FAILURE!
java.lang.AssertionError: Should have been given access EXECUTE on
abfss://abfs-testcontainer-098e6633-262e-4bf0-bad5-f5ab600f2...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFolderb1c428a49d24/test8.txt
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.assertAccessible(ITestAzureBlobFileSystemCheckAccess.java:326)
at
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemCheckAccess.testFsActionALL(ITestAzureBlobFileSystemCheckAccess.java:297)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemDelegationSAS
[WARNING] Tests run: 14, Failures: 0, Errors: 0, Skipped: 14, Time elapsed:
0.405 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemDelegationSAS
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsClient
[WARNING] Tests run: 5, Failures: 0, Errors: 0, Skipped: 2, Time elapsed:
53.346 s - in org.apache.hadoop.fs.azurebfs.ITestAbfsClient
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestFileSystemInitialization
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.675
s - in org.apache.hadoop.fs.azurebfs.ITestFileSystemInitialization
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsOutputStreamStatistics
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.041
s - in org.apache.hadoop.fs.azurebfs.ITestAbfsOutputStreamStatistics
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestGetNameSpaceEnabled
[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
3.7 s - in org.apache.hadoop.fs.azurebfs.ITestGetNameSpaceEnabled
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemAuthorization
[WARNING] Tests run: 29, Failures: 0, Errors: 0, Skipped: 29, Time elapsed:
0.911 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemAuthorization
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsDurationTrackers
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.83
s - in org.apache.hadoop.fs.azurebfs.ITestAbfsDurationTrackers
[INFO] Running org.apache.hadoop.fs.azurebfs.services.ITestAbfsInputStream
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.76
s - in org.apache.hadoop.fs.azurebfs.services.ITestAbfsInputStream
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemDelete
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.314
s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemDelete
[INFO] Running
org.apache.hadoop.fs.azurebfs.services.ITestAbfsInputStreamSmallFileReads
[INFO] Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
37.62 s - in
org.apache.hadoop.fs.azurebfs.services.ITestAbfsInputStreamSmallFileReads
[INFO] Running
org.apache.hadoop.fs.azurebfs.services.ITestAbfsInputStreamReadFooter
[INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
41.675 s - in
org.apache.hadoop.fs.azurebfs.services.ITestAbfsInputStreamReadFooter
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemLease
[INFO] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
81.806 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemLease
[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionALL:297->assertAccessible:326->Assert.assertTrue:42->Assert.fail:89
Should have been given access EXECUTE on
abfss://abfs-testcontainer-098e6633-262e-4bf0-bad5-f5ab600f2...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFolderb1c428a49d24/test8.txt
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionEXECUTE:222->assertAccessible:326->Assert.assertTrue:42->Assert.fail:89
Should have been given access EXECUTE on
abfss://abfs-testcontainer-0f7bb879-469d-499c-9949-c12f8a29e...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFoldereec6282e78a9/test3.txt
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionREAD:237->assertAccessible:326->Assert.assertTrue:42->Assert.fail:89
Should have been given access READ on
abfss://abfs-testcontainer-f32659ec-61fb-4ec3-865b-4dbbb4c95...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFolderf131b527a2a5/test4.txt
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionREADEXECUTE:267->assertAccessible:326->Assert.assertTrue:42->Assert.fail:89
Should have been given access EXECUTE on
abfss://abfs-testcontainer-c6593d53-53af-472f-87b3-3aebcf49a...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFoldere8852e291d68/test6.txt
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionWRITE:252->assertAccessible:326->Assert.assertTrue:42->Assert.fail:89
Should have been given access WRITE on
abfss://abfs-testcontainer-4d803dd2-6863-4838-b9d2-45a8b4f5f...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFolder55f27a0ad7c1/test5.txt
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testFsActionWRITEEXECUTE:282->assertAccessible:326->Assert.assertTrue:42->Assert.fail:89
Should have been given access EXECUTE on
abfss://abfs-testcontainer-423cd975-0340-4eed-b96b-6e2dee420...@hadoopazuretests.dfs.core.windows.net/fork-0005/test/CheckAccessTestFolderc7c7a77c8539/test7.txt
[ERROR] Errors:
[ERROR]
ITestAzureBlobFileSystemCheckAccess.testCheckAccessForNonExistentFile ?
Unexp...
[INFO]
[ERROR] Tests run: 568, Failures: 6, Errors: 1, Skipped: 99
[INFO]
[INFO]
[INFO] --- maven-failsafe-plugin:3.0.0-M1:integration-test
(integration-test-abfs-parallel-classes) @ hadoop-azure ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsLoadManifestsStage
[INFO] Running
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsManifestStoreOperations
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsReadWriteAndSeek
[INFO] Running
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemListStatus
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemE2EScale
[INFO] Running
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsTaskManifestFileIO
[INFO] Running
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsJobThroughManifestCommitter
[INFO] Running
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsRenameStageFailure
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
10.718 s - in
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsManifestStoreOperations
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
12.162 s - in org.apache.hadoop.fs.azurebfs.commit.ITestAbfsTaskManifestFileIO
[INFO] Running
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsManifestCommitProtocol
[WARNING] Tests run: 5, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
14.111 s - in org.apache.hadoop.fs.azurebfs.commit.ITestAbfsRenameStageFailure
[INFO] Running
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsCreateOutputDirectoriesStage
[INFO] Running org.apache.hadoop.fs.azurebfs.commit.ITestAbfsCleanupStage
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
23.451 s - in org.apache.hadoop.fs.azurebfs.commit.ITestAbfsLoadManifestsStage
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
25.735 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemE2EScale
[INFO] Running org.apache.hadoop.fs.azurebfs.commit.ITestAbfsTerasort
[INFO] Running org.apache.hadoop.fs.azurebfs.commit.ITestAbfsCommitTaskStage
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
14.123 s - in
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsCreateOutputDirectoriesStage
[INFO] Running org.apache.hadoop.fs.azurebfs.services.ITestReadBufferManager
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
17.632 s - in org.apache.hadoop.fs.azurebfs.commit.ITestAbfsCleanupStage
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestAbfsStreamStatistics
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.903
s - in org.apache.hadoop.fs.azurebfs.commit.ITestAbfsCommitTaskStage
[INFO] Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
38.482 s - in
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsJobThroughManifestCommitter
[INFO] Running
org.apache.hadoop.fs.azurebfs.extensions.ITestAbfsDelegationTokens
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractEtag
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
40.634 s - in org.apache.hadoop.fs.azurebfs.ITestAbfsReadWriteAndSeek
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.48
s - in org.apache.hadoop.fs.azurebfs.services.ITestReadBufferManager
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractDistCp
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.85
s - in org.apache.hadoop.fs.azurebfs.ITestAbfsStreamStatistics
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractRename
[WARNING] Tests run: 12, Failures: 0, Errors: 0, Skipped: 12, Time elapsed:
2.211 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractDistCp
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractSetTimes
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractOpen
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.279
s - in org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractEtag
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractMkdir
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
4.882 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractSetTimes
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractSeek
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.83
s - in org.apache.hadoop.fs.azurebfs.extensions.ITestAbfsDelegationTokens
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractCreate
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
13.566 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractRename
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractGetFileStatus
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
11.106 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractMkdir
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
61.877 s - in org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemListStatus
[INFO] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
15.391 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractOpen
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractRootDirectory
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsContractUnbuffer
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractConcat
[INFO] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
53.13 s - in
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsManifestCommitProtocol
[INFO] Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
15.265 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractSeek
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractAppend
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractDelete
[INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
13.587 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractCreate
[WARNING] Tests run: 9, Failures: 0, Errors: 0, Skipped: 9, Time elapsed:
9.375 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractRootDirectory
[INFO] Running
org.apache.hadoop.fs.azurebfs.contract.ITestAzureBlobFileSystemBasics
[WARNING] Tests run: 5, Failures: 0, Errors: 0, Skipped: 5, Time elapsed:
7.908 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractConcat
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.409
s - in org.apache.hadoop.fs.azurebfs.contract.ITestAbfsContractUnbuffer
[INFO] Running org.apache.hadoop.fs.azurebfs.ITestSmallWriteOptimization
[INFO] Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
17.828 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractGetFileStatus
[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
10.293 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractAppend
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.084
s - in org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractDelete
[INFO] Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
39.628 s - in
org.apache.hadoop.fs.azurebfs.contract.ITestAzureBlobFileSystemBasics
[WARNING] Tests run: 48, Failures: 0, Errors: 0, Skipped: 24, Time elapsed:
43.821 s - in org.apache.hadoop.fs.azurebfs.ITestSmallWriteOptimization
[ERROR] Tests run: 7, Failures: 0, Errors: 1, Skipped: 1, Time elapsed:
99.383 s <<< FAILURE! - in
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsTerasort
[ERROR]
test_120_terasort(org.apache.hadoop.fs.azurebfs.commit.ITestAbfsTerasort) Time
elapsed: 0.965 s <<< ERROR!
java.io.IOException: The ownership on the staging directory
/hadoop/hadoop-tools/hadoop-azure/target/test-dir/6/yarn-2023-01-27-12.46.30.90/yarn-47034590/apps_staging_dir/root/.staging
is not as expected. It is owned by 89e99dea-dc7e-48c8-8e8c-a41a97e6b877. The
directory must be owned by the submitter root or root
at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:152)
at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:113)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:147)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1677)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1674)
at java.base/java.security.AccessController.doPrivileged(Native
Method)
at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1953)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1674)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1695)
at
org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:334)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82)
at
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsTerasort.executeStage(ITestAbfsTerasort.java:206)
at
org.apache.hadoop.fs.azurebfs.commit.ITestAbfsTerasort.test_120_terasort(ITestAbfsTerasort.java:262)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:829)
[INFO]
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAbfsTerasort.test_120_terasort:262->executeStage:206 ? IO The
ownership o...
[INFO]
[ERROR] Tests run: 335, Failures: 0, Errors: 1, Skipped: 54
[INFO]
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0:enforce (depcheck) @ hadoop-azure ---
[INFO]
[INFO] --- maven-failsafe-plugin:3.0.0-M1:verify
(integration-test-abfs-parallel-classesAndMethods) @ hadoop-azure ---
[ERROR] There are test failures.
Please refer to /hadoop/hadoop-tools/hadoop-azure/target/failsafe-reports
for the individual test results.
Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump
and [date].dumpstream.
[INFO]
[INFO] --- maven-failsafe-plugin:3.0.0-M1:verify
(integration-test-abfs-parallel-classes) @ hadoop-azure ---
[ERROR] There are test failures.
Please refer to /hadoop/hadoop-tools/hadoop-azure/target/failsafe-reports
for the individual test results.
Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump
and [date].dumpstream.
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 05:24 min (Wall Clock)
[INFO] Finished at: 2023-01-27T12:48:04Z
[INFO]
------------------------------------------------------------------------
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
