[
https://issues.apache.org/jira/browse/HADOOP-18498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634253#comment-17634253
]
ASF GitHub Bot commented on HADOOP-18498:
-----------------------------------------
sreeb-msft commented on PR #5136:
URL: https://github.com/apache/hadoop/pull/5136#issuecomment-1315014607
------------------------
:::: AGGREGATED TEST RESULT ::::
HNS-OAuth
========================
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[INFO]
[ERROR] Tests run: 107, Failures: 1, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut
test timed o...
[INFO]
[ERROR] Tests run: 567, Failures: 0, Errors: 1, Skipped: 54
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
ITestReadBufferManager.testPurgeBufferManagerForParallelStreams:81->assertListEmpty:93
[After closing all streams InProgressList should be empty]
Expected size:<0> but was:<8> in:
<[org.apache.hadoop.fs.azurebfs.services.ReadBuffer@5603f1a0,
org.apache.hadoop.fs.azurebfs.services.ReadBuffer@393f101e,
org.apache.hadoop.fs.azurebfs.services.ReadBuffer@3ff11b9e,
org.apache.hadoop.fs.azurebfs.services.ReadBuffer@2bcb2f05,
org.apache.hadoop.fs.azurebfs.services.ReadBuffer@628c552d,
org.apache.hadoop.fs.azurebfs.services.ReadBuffer@23f21682,
org.apache.hadoop.fs.azurebfs.services.ReadBuffer@1468d489,
org.apache.hadoop.fs.azurebfs.services.ReadBuffer@66a97206]>
[INFO]
[ERROR] Tests run: 333, Failures: 1, Errors: 0, Skipped: 41
HNS-SharedKey
========================
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[INFO]
[ERROR] Tests run: 107, Failures: 1, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut
test timed o...
[INFO]
[ERROR] Tests run: 567, Failures: 0, Errors: 1, Skipped: 54
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
ITestReadBufferManager.testPurgeBufferManagerForParallelStreams:81->assertListEmpty:93
[After closing all streams InProgressList should be empty]
Expected size:<0> but was:<1> in:
<[org.apache.hadoop.fs.azurebfs.services.ReadBuffer@2005b29f]>
[ERROR] Errors:
[ERROR]
ITestAbfsManifestCommitProtocol>TestManifestCommitProtocol.testCommitLifecycle:928->TestManifestCommitProtocol.commitJob:1815
» FileNotFound
[ERROR]
ITestAbfsManifestCommitProtocol>TestManifestCommitProtocol.testCommitterWithDuplicatedCommit:1009
» FileNotFound
[ERROR]
ITestAbfsManifestCommitProtocol>TestManifestCommitProtocol.testMapFileOutputCommitter:1211->TestManifestCommitProtocol.commitTaskAndJob:661
» FileNotFound
[INFO]
[ERROR] Tests run: 333, Failures: 1, Errors: 3, Skipped: 41
NonHNS-SharedKey
========================
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[INFO]
[ERROR] Tests run: 107, Failures: 1, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:334 » TestTimedOut
test timed o...
[INFO]
[ERROR] Tests run: 567, Failures: 0, Errors: 1, Skipped: 277
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
ITestAbfsTerasort.test_110_teragen:244->executeStage:211->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89
teragen(1000,
abfs://[email protected]/ITestAbfsTerasort/sortin)
failed expected:<0> but was:<1>
[ERROR]
ITestAbfsFileSystemContractDistCp>AbstractContractDistCpTest.testDistCpWithIterator:681->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89
expected:<0> but was:<-999>
[ERROR] ITestReadBufferManager.testPurgeBufferManagerForParallelStreams:85
[After closing all streams free list contents should match with [0, 1, 2, 3, 4,
5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]]
Expected size:<16> but was:<4> in:
<[7, 15, 6, 8]>
[ERROR] Errors:
[ERROR] ITestAbfsJobThroughManifestCommitter.test_0420_validateJob »
OutputValidation ...
[ERROR] ITestAbfsManifestCommitProtocol.testCommitLifecycle »
OutputValidation `abfs:/...
[ERROR] ITestAbfsManifestCommitProtocol.testCommitterWithDuplicatedCommit
» OutputValidation
[ERROR] ITestAbfsManifestCommitProtocol.testConcurrentCommitTaskWithSubDir
» OutputValidation
[ERROR] ITestAbfsManifestCommitProtocol.testMapFileOutputCommitter »
OutputValidation ...
[ERROR] ITestAbfsManifestCommitProtocol.testOutputFormatIntegration »
OutputValidation
[ERROR] ITestAbfsManifestCommitProtocol.testParallelJobsToAdjacentPaths »
OutputValidation
[ERROR] ITestAbfsManifestCommitProtocol.testTwoTaskAttemptsCommit »
OutputValidation `...
[ERROR]
ITestAbfsFileSystemContractDistCp>AbstractContractDistCpTest.testTrackDeepDirectoryStructureToRemote:401->AbstractContractDistCpTest.runDistCp:621
» IO
[ERROR]
ITestAbfsFileSystemContractDistCp>AbstractContractDistCpTest.testUpdateDeepDirectoryStructureNoChange:262->AbstractContractDistCpTest.distCpDeepDirectoryStructure:541
» FileNotFound
[ERROR]
ITestAbfsFileSystemContractGetFileStatus>AbstractContractGetFileStatusTest.testComplexDirActions:151->AbstractContractGetFileStatusTest.createTestTree:494
» FileNotFound
[ERROR]
ITestAbfsFileSystemContractGetFileStatus>AbstractContractGetFileStatusTest.testListStatusFile:353
» FileNotFound
[ERROR]
ITestAbfsFileSystemContractGetFileStatus>AbstractContractGetFileStatusTest.testListStatusIteratorFile:359->AbstractContractGetFileStatusTest.touchf:466
» FileNotFound
[INFO]
[ERROR] Tests run: 333, Failures: 3, Errors: 13, Skipped: 46
AppendBlob-HNS-OAuth
========================
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestAccountConfiguration.testConfigPropNotFound:386->testMissingConfigKey:399
Expected a
org.apache.hadoop.fs.azurebfs.contracts.exceptions.TokenAccessProviderException
to be thrown, but got the result: :
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider"
[INFO]
[ERROR] Tests run: 107, Failures: 1, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut
test timed o...
[INFO]
[ERROR] Tests run: 567, Failures: 0, Errors: 1, Skipped: 54
[INFO] Results:
[INFO]
[WARNING] Tests run: 333, Failures: 0, Errors: 0, Skipped: 41
Time taken: 47 mins 28 secs.
> [ABFS]: Error introduced when SAS Token containing '?' prefix is passed
> -----------------------------------------------------------------------
>
> Key: HADOOP-18498
> URL: https://issues.apache.org/jira/browse/HADOOP-18498
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
> Reporter: Sree Bhattacharyya
> Assignee: Sree Bhattacharyya
> Priority: Minor
> Labels: pull-request-available
>
> Error Description:
> At present, SAS Tokens generated from the Azure Portal may or may not contain
> a ? as a prefix. SAS Tokens that contain the ? prefix will lead to an error
> in the driver due to a clash of query parameters. This leads to customers
> having to manually remove the ? prefix before passing the SAS Tokens.
> Mitigation:
> After receiving the SAS Token from the provider, check if any prefix ? is
> present or not. If present, remove it and pass the SAS Token.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
