[
https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17812811#comment-17812811
]
ASF GitHub Bot commented on HADOOP-18993:
-----------------------------------------
agilelab-tmnd1991 commented on PR #6301:
URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1919541155
This the result of verify, looks good to me:
```
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestS3AClosedFS.testClosedInstrumentation:111
[S3AInstrumentation.hasMetricSystem()] expected:<[fals]e> but was:<[tru]e>
[ERROR] ITestS3AConfiguration.testS3SpecificSignerOverride:582 Expected a
java.io.IOException to be thrown, but got the result: :
HeadBucketResponse(BucketRegion=eu-west-1, AccessPointAlias=false)
[ERROR]
ITestS3ACommitterFactory.testEverything:115->testInvalidFileBinding:165
Expected a org.apache.hadoop.fs.s3a.commit.PathCommitException to be thrown,
but got the result: :
FileOutputCommitter{PathOutputCommitter{context=TaskAttemptContextImpl{JobContextImpl{jobId=job_202401310688_0001};
taskId=attempt_202401310688_0001_m_000000_0, status=''};
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter@2534ada2};
outputPath=s3a://agile-hadoop-s3-test/test/testEverything,
workPath=s3a://agile-hadoop-s3-test/test/testEverything/_temporary/1/_temporary/attempt_202401310688_0001_m_000000_0,
algorithmVersion=1, skipCleanup=false, ignoreCleanupFailures=false}
[ERROR]
ITestS3AFileSystemStatistic.testBytesReadWithStream:72->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89
Mismatch in number of FS bytes read by InputStreams expected:<2048> but
was:<19636738>
[ERROR] Errors:
[ERROR] ITestS3AAWSCredentialsProvider.testAnonymousProvider:184 »
AWSRedirect Receive...
[ERROR]
ITestS3ACannedACLs>AbstractS3ATestBase.setup:111->AbstractFSContractTestBase.setup:205->AbstractFSContractTestBase.mkdirs:363
» AWSBadRequest
[ERROR]
ITestS3AFailureHandling.testMultiObjectDeleteNoPermissions:186->lambda$testMultiObjectDeleteNoPermissions$1:188
» S3
[ERROR]
ITestS3AFailureHandling.testSingleObjectDeleteNoPermissionsTranslated:212->lambda$testSingleObjectDeleteNoPermissionsTranslated$2:213
» AWSRedirect
[ERROR] ITestS3APrefetchingCacheFiles.testCacheFileExistence:111 »
AWSRedirect Receive...
[ERROR]
ITestS3ARequesterPays.testRequesterPaysDisabledFails:108->lambda$testRequesterPaysDisabledFails$0:112
» AWSRedirect
[ERROR] ITestS3ARequesterPays.testRequesterPaysOptionSuccess:72 »
AWSRedirect Received...
[ERROR] ITestDelegatedMRJob.testCommonCrawlLookup:234 » AccessDenied
s3a://osm-pds/pla...
[ERROR] ITestDelegatedMRJob.testCommonCrawlLookup:234 » AccessDenied
s3a://osm-pds/pla...
[ERROR] ITestDelegatedMRJob.testJobSubmissionCollectsTokens:281 »
AccessDenied s3a://o...
[ERROR] ITestDelegatedMRJob.testJobSubmissionCollectsTokens:281 »
AccessDenied s3a://o...
[ERROR]
ITestSessionDelegationInFilesystem.testDelegatedFileSystem:347->readLandsatMetadata:614
» AccessDenied
[ERROR]
ITestS3GuardTool.testLandsatBucketRequireEncrypted:85->AbstractS3GuardToolTestBase.runToFailure:128->AbstractS3GuardToolTestBase.lambda$runToFailure$0:129
» AWSRedirect
[ERROR]
ITestS3GuardTool.testLandsatBucketRequireGuarded:68->AbstractS3GuardToolTestBase.runToFailure:128->AbstractS3GuardToolTestBase.lambda$runToFailure$0:129
» AWSRedirect
[ERROR]
ITestS3GuardTool.testLandsatBucketRequireUnencrypted:78->AbstractS3GuardToolTestBase.run:114
» AWSRedirect
[ERROR]
ITestS3GuardTool.testLandsatBucketUnguarded:61->AbstractS3GuardToolTestBase.run:114
» AWSRedirect
[ERROR] ITestAWSStatisticCollection.testCommonCrawlStatistics:74 »
AccessDenied s3a://...
[ERROR] ITestAWSStatisticCollection.testLandsatStatistics:56 »
AccessDenied s3a://land...
[ERROR]
ITestMarkerTool.testRunAuditManyObjectsInBucket:318->AbstractMarkerToolTest.runToFailure:274
» AWSRedirect
[INFO]
[ERROR] Tests run: 1277, Failures: 4, Errors: 19, Skipped: 295
```
> Allow to not isolate S3AFileSystem classloader when needed
> ----------------------------------------------------------
>
> Key: HADOOP-18993
> URL: https://issues.apache.org/jira/browse/HADOOP-18993
> Project: Hadoop Common
> Issue Type: Improvement
> Components: hadoop-thirdparty
> Affects Versions: 3.3.6
> Reporter: Antonio Murgia
> Priority: Minor
> Labels: pull-request-available
>
> In HADOOP-17372 the S3AFileSystem forces the configuration classloader to be
> the same as the one that loaded S3AFileSystem. This leads to the
> impossibility in Spark applications to load third party credentials providers
> as user jars.
> I propose to add a configuration key
> {{fs.s3a.extensions.isolated.classloader}} with a default value of {{true}}
> that if set to {{false}} will not perform the classloader set.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
