[
https://issues.apache.org/jira/browse/SPARK-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304012#comment-15304012
]
Sean Owen commented on SPARK-15579:
-----------------------------------
Is the issue that the RDD will be GCed at some point in the near future and
will be unpersisted? that could explain all the behavior here. But that is by
design. If you can reproduce it when holding a ref to it, that's a clear
problem.
> SparkUI: Storage page is empty even if things are cached
> --------------------------------------------------------
>
> Key: SPARK-15579
> URL: https://issues.apache.org/jira/browse/SPARK-15579
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Web UI
> Affects Versions: 2.0.0
> Reporter: Andrew Or
>
> scala> sc.parallelize(1 to 10000, 5000).cache().count()
> SparkUI storage page is empty.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
