[
https://issues.apache.org/jira/browse/SPARK-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aditya Rao updated SPARK-7928:
------------------------------
Description:
in hadoop 2.7.0 the link to App Master Log has been disabled as the YARN Job
History Server would show the app master logs in the Resource Manager UI, but
Spark Historyserver doesn't show the app master logs.
So anyone who is running a spark job in yarn-cluster mode has no way to know
the results other than checking the userlogs manually.
was:
in hadoop 2.7.0 the link to App Master Log has been disabled as the YARN Job
History Server would show the app master logs, but Spark Historyserver doesn't
show the app master logs.
So anyone who is running a spark job in yarn-cluster mode has no way to know
the results other than checking the userlogs manually.
> Yarn App Master Logs are not displayed in the spark historyserver UI
> --------------------------------------------------------------------
>
> Key: SPARK-7928
> URL: https://issues.apache.org/jira/browse/SPARK-7928
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.2.1, 1.3.1
> Environment: yarn hadoop 2.7.0
> Reporter: Aditya Rao
>
> in hadoop 2.7.0 the link to App Master Log has been disabled as the YARN Job
> History Server would show the app master logs in the Resource Manager UI,
> but Spark Historyserver doesn't show the app master logs.
> So anyone who is running a spark job in yarn-cluster mode has no way to know
> the results other than checking the userlogs manually.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
