[
https://issues.apache.org/jira/browse/SPARK-21013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-21013:
--------------------------------
Priority: Minor (was: Major)
> Spark History Server does not show the logs of completed Yarn Jobs
> ------------------------------------------------------------------
>
> Key: SPARK-21013
> URL: https://issues.apache.org/jira/browse/SPARK-21013
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.6.1, 2.0.1, 2.1.0
> Reporter: Hari Ck
> Priority: Minor
> Labels: historyserver, ui
>
> I am facing issue when accessing the container logs of a completed Spark
> (Yarn) application from the History Server.
> Repro Steps:
> 1) Run the spark-shell in yarn client mode. Or run Pi job in Yarn mode.
> 2) Once the job is completed, (in the case of spark shell, exit after doing
> some simple operations), try to access the STDOUT or STDERR logs of the
> application from the Executors tab in the Spark History Server UI.
> 3) If yarn log aggregation is enabled, then logs won't be available in node
> manager's log location. But history Server is trying to access the logs from
> the nodemanager's log location giving below error in the UI:
> Failed redirect for container_e31_1496881617682_0003_01_000002
> ResourceManager
> RM Home
> NodeManager
> Tools
> Failed while trying to construct the redirect url to the log server. Log
> Server url may not be configured
> java.lang.Exception: Unknown container. Container either has not started or
> has already completed or doesn't belong to this node at all.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
