[
https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020897#comment-14020897
]
Reynold Xin commented on SPARK-2064:
------------------------------------
Is memory really an issue here?
On a 1000 node cluster, let's say we need 1KB to track each executor (should be
more than enough), then we need 1MB to track all of them. In less than 100MB,
we can crash & restart all of them 100 times.
If it really becomes the problem perhaps we can clean dead ones after a certain
time period.
> web ui should not remove executors if they are dead
> ---------------------------------------------------
>
> Key: SPARK-2064
> URL: https://issues.apache.org/jira/browse/SPARK-2064
> Project: Spark
> Issue Type: Sub-task
> Reporter: Reynold Xin
>
> We should always show the list of executors that have ever been connected,
> and add a status column to mark them as dead if they have been disconnected.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
