[
https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021018#comment-14021018
]
Reynold Xin commented on SPARK-2064:
------------------------------------
One thing is we can help identify executors that are dead, which is often
important for debugging (finding out why they are dead - maybe disk space full
resulting system irresponsive, etc). It is often also very useful information
to have for spot instances on EC2 where executors might just die.
If memory is the problem, we can cap the number of dead executors the UI
tracks; alternatively, we can put the list of dead executors onto external
storage (a sqlite database or even just text file in the log directory).
> web ui should not remove executors if they are dead
> ---------------------------------------------------
>
> Key: SPARK-2064
> URL: https://issues.apache.org/jira/browse/SPARK-2064
> Project: Spark
> Issue Type: Sub-task
> Reporter: Reynold Xin
>
> We should always show the list of executors that have ever been connected,
> and add a status column to mark them as dead if they have been disconnected.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
