[
https://issues.apache.org/jira/browse/HBASE-15570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220308#comment-15220308
]
Sean Busbey commented on HBASE-15570:
-------------------------------------
My hope is to piggy back on the renewal that Spark already has for HDFS (or
atleast ape it so that eventual integration can happen).
My understanding from reading through that code is that the AM has a keytab, it
periodically renews its kerberos credentials if needed, and periodically
requests new delegation tokens that it pushes out to the executors.
I'd strongly prefer to avoid changing the way the HBase server side handles
tokens, so it'd be new tokens most likely.
> renewable delegation tokens for long-lived spark applications
> -------------------------------------------------------------
>
> Key: HBASE-15570
> URL: https://issues.apache.org/jira/browse/HBASE-15570
> Project: HBase
> Issue Type: Improvement
> Components: spark
> Reporter: Sean Busbey
> Assignee: Sean Busbey
>
> Right now our spark integration works on secure clusters by getting
> delegation tokens and sending them to the executors. Unfortunately,
> applications that need to run for longer than the delegation token lifetime
> (by default 7 days) will fail.
> In particular, this is an issue for Spark Streaming applications. Since they
> expect to run indefinitely, we should have a means for renewing the
> delegation tokens.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
