[
https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18993:
------------------------------------
Description:
In HADOOP-17372 the S3AFileSystem forces the configuration classloader to be
the same as the one that loaded S3AFileSystem. This leads to the impossibility
in Spark applications to load third party credentials providers as user jars.
The option fs.s3a.classloader.isolation (default: true) can be set to false to
disable s3a classloader isolation;
This can assist in using custom credential providers and other extension points.
was:
In HADOOP-17372 the S3AFileSystem forces the configuration classloader to be
the same as the one that loaded S3AFileSystem. This leads to the impossibility
in Spark applications to load third party credentials providers as user jars.
I propose to add a configuration key {{fs.s3a.extensions.isolated.classloader}}
with a default value of {{true}} that if set to {{false}} will not perform the
classloader set.
> S3A: Add option fs.s3a.classloader.isolation (#6301)
> ----------------------------------------------------
>
> Key: HADOOP-18993
> URL: https://issues.apache.org/jira/browse/HADOOP-18993
> Project: Hadoop Common
> Issue Type: Improvement
> Components: hadoop-thirdparty
> Affects Versions: 3.3.6
> Reporter: Antonio Murgia
> Assignee: Antonio Murgia
> Priority: Minor
> Labels: pull-request-available
> Fix For: 3.5.0, 3.4.1
>
>
> In HADOOP-17372 the S3AFileSystem forces the configuration classloader to be
> the same as the one that loaded S3AFileSystem. This leads to the
> impossibility in Spark applications to load third party credentials providers
> as user jars.
> The option fs.s3a.classloader.isolation (default: true) can be set to false
> to disable s3a classloader isolation;
> This can assist in using custom credential providers and other extension
> points.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
