[
https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035131#comment-15035131
]
Warren Wang commented on SPARK-4049:
------------------------------------
This issue is really annoying when the rdd is reused for many times. For a
particular execution, the fraction cached will increase 1%-10% unreasonably and
never return back to 100%. When the rdd is reused for hundred times, the
fraction cached will eventually reach to 200%, on which situation the spark job
will crash for no more memory to use. Hope this to be fixed.
> Storage web UI "fraction cached" shows as > 100%
> ------------------------------------------------
>
> Key: SPARK-4049
> URL: https://issues.apache.org/jira/browse/SPARK-4049
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.2.0
> Reporter: Josh Rosen
> Priority: Minor
>
> In the Storage tab of the Spark Web UI, I saw a case where the "Fraction
> Cached" was greater than 100%:
> !http://i.imgur.com/Gm2hEeL.png!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
