[
https://issues.apache.org/jira/browse/SPARK-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334839#comment-14334839
]
Tathagata Das commented on SPARK-5967:
--------------------------------------
They are similar but not the same. Those were bugs in the old code, and this
bug is in the new refactored JobProgressListener. This refactoring and hence
the bug was done in Spark 1.2
> JobProgressListener.stageIdToActiveJobIds never cleared
> -------------------------------------------------------
>
> Key: SPARK-5967
> URL: https://issues.apache.org/jira/browse/SPARK-5967
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.2.0, 1.3.0, 1.2.1
> Reporter: Tathagata Das
> Assignee: Tathagata Das
> Priority: Blocker
>
> The hashmap stageIdToActiveJobIds in JobProgressListener is never cleared. So
> the hashmap keep increasing in size indefinitely. This is a blocker for 24/7
> running applications like Spark Streaming apps.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
