CLevasseur commented on PR #4262:
URL: https://github.com/apache/hadoop/pull/4262#issuecomment-1328860096
I have pulled the latest changes. It now fails when running the tests. Note
that it also fails when I run the tests from the trunk branch of the
`apache/hadoop` repository.
I haven't setup OAuth2, is that alright if we just run those tests using the
Shared Key ?
Also, it looks like those tests create a lot of containers in the storage
account, is there an easy way to clean those ?
**Tests Output (Both apache/hadoop:trunk and CLevasseur/hadoop:trunk give
the same errors)**
**NonHNS-SharedKey**:
```
Choose action:
[Note - SET_ACTIVE_TEST_CONFIG will help activate the config for IDE/single
test class runs]
1) SET_ACTIVE_TEST_CONFIG
2) RUN_TEST
3) CLEAN_UP_OLD_TEST_CONTAINERS
4) SET_OR_CHANGE_TEST_ACCOUNT
5) PRINT_LOG4J_LOG_PATHS_FROM_LAST_RUN
#? 2
Enter parallel test run process count [default - 8]:
Set the active test combination to run the action:
1) HNS-OAuth
2) HNS-SharedKey
3) nonHNS-SharedKey
4) AppendBlob-HNS-OAuth
5) AllCombinationsTestRun
6) Quit
#? 3
Combination specific property setting: [ key=fs.azure.account.auth.type ,
value=SharedKey ]
Activated [src/test/resources/abfs-combination-test-configs.xml] - for
account: dataenginfraus3prod for combination NonHNS-SharedKey
Running test for combination NonHNS-SharedKey on account dataenginfraus3prod
[ProcessCount=8]
Test run report can be seen in
dev-support/testlogs/2022-11-28_10-12-22/Test-Logs-NonHNS-SharedKey.txt
pcregrep: pcre_exec() gave error -27 while matching text that starts:
[ERROR]
ITestAzureBlobFileSystemMainOperation>FSMainOperationsBaseTest.testGlobStatusFilterWithEmptyPathResults:492
? AbfsRestOperation
[ERROR] ITestAzureBlobF
pcregrep: Error -8, -21 or -27 means that a resource limit was exceeded.
pcregrep: Check your regex for nested unlimited loops.
----- Test results -----
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[ERROR] Errors:
[ERROR]
TestTracingContext.testClientCorrelationId:64->checkCorrelationConfigValidation:84
? FileAlreadyExists
[ERROR]
TestAbfsInputStream.testDefaultReadaheadQueueDepth:696->AbstractAbfsIntegrationTest.getFileSystem:302
? FileAlreadyExists
[ERROR]
TestAbfsInputStream.testDiffReadRequestSizeAndRAHBlockSize:670->testReadAheadConfigs:762->createTestFile:814
? FileAlreadyExists
[ERROR] TestAbfsInputStream.testOpenFileWithOptions:259 ?
AbfsRestOperation Operation ...
[INFO]
[ERROR] Tests run: 107, Failures: 1, Errors: 4, Skipped: 2
pcregrep: pcre_exec() gave error -27 while matching text that starts:
[ERROR]
ITestAzureBlobFileSystemMainOperation>FSMainOperationsBaseTest.testGlobStatusFilterWithEmptyPathResults:492
? AbfsRestOperation
[ERROR] ITestAzureBlobF
pcregrep: Error -8, -21 or -27 means that a resource limit was exceeded.
pcregrep: Check your regex for nested unlimited loops.
Time taken: 2 mins 21 secs.
Find test result for the combination (NonHNS-SharedKey) in:
dev-support/testlogs/2022-11-28_10-12-22/Test-Logs-NonHNS-SharedKey.txt
Consolidated test result is saved in:
dev-support/testlogs/2022-11-28_10-12-22/Test-Results.txt
------------------------
:::: AGGREGATED TEST RESULT ::::
NonHNS-SharedKey
========================
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[ERROR] Errors:
[ERROR]
TestTracingContext.testClientCorrelationId:64->checkCorrelationConfigValidation:84
? FileAlreadyExists
[ERROR]
TestAbfsInputStream.testDefaultReadaheadQueueDepth:696->AbstractAbfsIntegrationTest.getFileSystem:302
? FileAlreadyExists
[ERROR]
TestAbfsInputStream.testDiffReadRequestSizeAndRAHBlockSize:670->testReadAheadConfigs:762->createTestFile:814
? FileAlreadyExists
[ERROR] TestAbfsInputStream.testOpenFileWithOptions:259 ?
AbfsRestOperation Operation ...
[INFO]
[ERROR] Tests run: 107, Failures: 1, Errors: 4, Skipped: 2
```
**HNS-SharedKey**:
```
Set the active test combination to run the action:
1) HNS-OAuth
2) HNS-SharedKey
3) nonHNS-SharedKey
4) AppendBlob-HNS-OAuth
5) AllCombinationsTestRun
6) Quit
#? 2
Combination specific property setting: [ key=fs.azure.account.auth.type ,
value=SharedKey ]
Activated [src/test/resources/abfs-combination-test-configs.xml] - for
account: dataenginfraus3prod for combination HNS-SharedKey
Running test for combination HNS-SharedKey on account dataenginfraus3prod
[ProcessCount=8]
Test run report can be seen in
dev-support/testlogs/2022-11-28_10-23-41/Test-Logs-HNS-SharedKey.txt
pcregrep: pcre_exec() gave error -27 while matching text that starts:
[ERROR]
ITestAzureBlobFileSystemMainOperation>FSMainOperationsBaseTest.testGlobStatusFilterWithEmptyPathResults:492
? AbfsRestOperation
[ERROR] ITestAzureBlobF
pcregrep: Error -8, -21 or -27 means that a resource limit was exceeded.
pcregrep: Check your regex for nested unlimited loops.
----- Test results -----
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[ERROR] Errors:
[ERROR]
TestTracingContext.testClientCorrelationId:64->checkCorrelationConfigValidation:84
? FileAlreadyExists
[ERROR]
TestAbfsInputStream.testDefaultReadaheadQueueDepth:696->AbstractAbfsIntegrationTest.getFileSystem:302
? FileAlreadyExists
[ERROR]
TestAbfsInputStream.testDiffReadRequestSizeAndRAHBlockSize:670->testReadAheadConfigs:762->createTestFile:814
? FileAlreadyExists
[ERROR] TestAbfsInputStream.testOpenFileWithOptions:259 ?
AbfsRestOperation Operation ...
[INFO]
[ERROR] Tests run: 107, Failures: 1, Errors: 4, Skipped: 2
pcregrep: pcre_exec() gave error -27 while matching text that starts:
[ERROR]
ITestAzureBlobFileSystemMainOperation>FSMainOperationsBaseTest.testGlobStatusFilterWithEmptyPathResults:492
? AbfsRestOperation
[ERROR] ITestAzureBlobF
pcregrep: Error -8, -21 or -27 means that a resource limit was exceeded.
pcregrep: Check your regex for nested unlimited loops.
Time taken: 2 mins 22 secs.
Find test result for the combination (HNS-SharedKey) in:
dev-support/testlogs/2022-11-28_10-23-41/Test-Logs-HNS-SharedKey.txt
Consolidated test result is saved in:
dev-support/testlogs/2022-11-28_10-23-41/Test-Results.txt
------------------------
:::: AGGREGATED TEST RESULT ::::
HNS-SharedKey
========================
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[ERROR] Errors:
[ERROR]
TestTracingContext.testClientCorrelationId:64->checkCorrelationConfigValidation:84
? FileAlreadyExists
[ERROR]
TestAbfsInputStream.testDefaultReadaheadQueueDepth:696->AbstractAbfsIntegrationTest.getFileSystem:302
? FileAlreadyExists
[ERROR]
TestAbfsInputStream.testDiffReadRequestSizeAndRAHBlockSize:670->testReadAheadConfigs:762->createTestFile:814
? FileAlreadyExists
[ERROR] TestAbfsInputStream.testOpenFileWithOptions:259 ?
AbfsRestOperation Operation ...
[INFO]
[ERROR] Tests run: 107, Failures: 1, Errors: 4, Skipped: 2
Time taken: 2 mins 41 secs.
```
Any idea why those tests are failing ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
