SaintBacchus created SPARK-10755:
------------------------------------
Summary: Set the driver also update the token for long-running
application
Key: SPARK-10755
URL: https://issues.apache.org/jira/browse/SPARK-10755
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.6.0
Reporter: SaintBacchus
In the yarn-client mode, driver will write the event logs into hdfs and get the
partition information from hdfs, so it's nessary to update the token from the
*AMDelegationTokenRenewer*.
In the yarn-cluster mode, driver is company with AM and token will update by
AM. But it's still better to update the token for client process since the
client wants to delete the staging dir with a expired token.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
