[ 
https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214394#comment-15214394
 ] 

Thomas Graves commented on SPARK-13829:
---------------------------------------

Can you clarify this, is this the case you are using secure hbase or hive with 
non-secure hdfs?    If so can you update the description otherwise there is no 
reason to use keytab/principal.   I don't think it was written with that use 
case in mind so if that is useful we would have to add support for that.  We 
assume if we are using security its for all the services.


> Spark submit with keytab can't submit to a non-HDFS yarn cluster
> ----------------------------------------------------------------
>
>                 Key: SPARK-13829
>                 URL: https://issues.apache.org/jira/browse/SPARK-13829
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.6.1
>         Environment: Yarn cluster, spark submit launching with keytab& 
> principal, cluster filesystem is *not* HDFS.
>            Reporter: Steve Loughran
>
> If you try to submit work to a secure YARN cluster running on any FS other 
> than HDFS, using a keytab+principal over kinited user, you get to see a stack 
> trace from inside {{Client.getTokenRenewalInterval}}
> root cause: there is no HDFS to get a delegation token, hence no delegation 
> token to examine for a renewal interval



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to