[
https://issues.apache.org/jira/browse/SPARK-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14184620#comment-14184620
]
Andrew Or commented on SPARK-2105:
----------------------------------
Hey Josh I think this was fixed by this commit:
https://github.com/apache/spark/commit/d934801d53fc2f1d57d3534ae4e1e9384c7dda99
The root cause is because we were dropping events, and that happened because
one of the listeners was taking all the time to process the events. We may run
into this only if the application attaches arbitrary listeners to Spark and
these listeners perform expensive operations, but from Spark's side I don't
think there's anything we can do about that.
> SparkUI doesn't remove active stages that failed
> ------------------------------------------------
>
> Key: SPARK-2105
> URL: https://issues.apache.org/jira/browse/SPARK-2105
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Web UI
> Affects Versions: 1.0.0
> Reporter: Andrew Or
>
> If a stage fails because its tasks cannot be serialized, for instance, the
> failed stage remains in the Active Stages section forever. This is because
> the StageCompleted event is never posted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
