[ 
https://issues.apache.org/jira/browse/SPARK-20059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Saisai Shao updated SPARK-20059:
--------------------------------
    Description: 
{{HBaseCredentialProvider}} uses system classloader instead of child 
classloader, which will make HBase jars specified with {{--jars}} fail to work, 
so here we should use the right class loader.

Besides in yarn cluster mode jars specified with {{--jars}} is not added into 
client's class path, which will make it fail to load HBase jars and issue 
tokens in our scenario. Also some customized credential provider cannot be 
registered into client.

So here I will fix this two issues.



  was:
{{HBaseCredentialProvider}} uses system classloader instead of child 
classloader, which will make HBase jars specified with {{--jars}} fail to work, 
so here we should use the right class loader.

Besides in yarn client mode jars specified with {{--jars}} is not added into 
client's class path, which will make it fail to load HBase jars and issue 
tokens in our scenario. Also some customized credential provider cannot be 
registered into client.

So here I will fix this two issues.




> HbaseCredentialProvider uses wrong classloader
> ----------------------------------------------
>
>                 Key: SPARK-20059
>                 URL: https://issues.apache.org/jira/browse/SPARK-20059
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 2.1.0, 2.2.0
>            Reporter: Saisai Shao
>
> {{HBaseCredentialProvider}} uses system classloader instead of child 
> classloader, which will make HBase jars specified with {{--jars}} fail to 
> work, so here we should use the right class loader.
> Besides in yarn cluster mode jars specified with {{--jars}} is not added into 
> client's class path, which will make it fail to load HBase jars and issue 
> tokens in our scenario. Also some customized credential provider cannot be 
> registered into client.
> So here I will fix this two issues.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to