[
https://issues.apache.org/jira/browse/SPARK-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-17209:
--------------------------------
Description:
Current Spark on YARN supports time based credential renewal and updating, this
mainly addresses the problem of token expiration for long running Spark
applications.
But still there're some use cases in which security services will be changed in
the run-time of Spark application. For example, user may want to change to
access another HBase cluster or Hive Metastore service in the run-time, in such
use cases credentials should be updated immediately by user explicitly, so that
user could reconnect to new HBase cluster or Metastore service.
So here propose to add ability in Spark to manually trigger the credential
updating in the run-time.
This is a follow-up work of SPARK-14743.
was:
Current Spark on YARN supports time based credential renewal and updating, this
mainly addresses the problem of token expiration for long running Spark
applications.
But still there're some use cases in which security services will be changed in
the run-time of Spark application. For example, user may want to change to
access another HBase cluster or Hive Metastore service in the run-time, in such
use cases credentials should be updated immediately by user explicitly, so that
user could reconnect to new HBase cluster or Metastore service.
So here propose to add ability in Spark to manually trigger the credential
updating in the run-time.
This is a follow-up works of SPARK-14743.
> Support manual credential updating in the run-time for Spark on YARN
> --------------------------------------------------------------------
>
> Key: SPARK-17209
> URL: https://issues.apache.org/jira/browse/SPARK-17209
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core, YARN
> Reporter: Saisai Shao
> Priority: Minor
>
> Current Spark on YARN supports time based credential renewal and updating,
> this mainly addresses the problem of token expiration for long running Spark
> applications.
> But still there're some use cases in which security services will be changed
> in the run-time of Spark application. For example, user may want to change to
> access another HBase cluster or Hive Metastore service in the run-time, in
> such use cases credentials should be updated immediately by user explicitly,
> so that user could reconnect to new HBase cluster or Metastore service.
> So here propose to add ability in Spark to manually trigger the credential
> updating in the run-time.
> This is a follow-up work of SPARK-14743.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
