Hi All,
A long running Spark job on YARN throws below exception after running
for few days.
yarn.ApplicationMaster: Reporter thread fails 1 time(s) in a row.
org.apache.hadoop.yarn.exceptions.YarnException: *No AMRMToken found* for
user prabhu at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUti
l.java:45)
Do any of the below renew the AMRMToken and solve the issue
1. yarn-resourcemanager.delegation.token.max-lifetime increase from 7 days
2. Configuring Proxy user:
<property> <name>hadoop.proxyuser.yarn.hosts</name> <value>*</value>
</property>
<property> <name>hadoop.proxyuser.yarn.groups</name> <value>*</value>
</property>
3. Can Spark-1.4.0 handle with fix
https://issues.apache.org/jira/browse/SPARK-5342
spark.yarn.credentials.file
How to renew the AMRMToken for a long running job on YARN?
Thanks,
Prabhu Joseph
