Github user scwf commented on the pull request:
https://github.com/apache/spark/pull/567#issuecomment-41487284
if java heap = 10g and spark.storage.memoryFraction has default value 0.6,
actually it means spark memory cache can use memory up to 0.6*10g and if there
is no rdd cache or this fraction of memory has not been used completely, spark
task computation can also make use of it.
but now the description may misunderstanding that jvm allocate 0.6*10g only
for rdd cache and spark task computation can not make use of this fraction
memory.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
