[ 
https://issues.apache.org/jira/browse/SPARK-12817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097418#comment-15097418
 ] 

Apache Spark commented on SPARK-12817:
--------------------------------------

User 'JoshRosen' has created a pull request for this issue:
https://github.com/apache/spark/pull/10748

> Simplify CacheManager code and remove unused BlockManager methods
> -----------------------------------------------------------------
>
>                 Key: SPARK-12817
>                 URL: https://issues.apache.org/jira/browse/SPARK-12817
>             Project: Spark
>          Issue Type: Improvement
>          Components: Block Manager
>            Reporter: Josh Rosen
>            Assignee: Josh Rosen
>
> CacheManager directly calls MemoryStore.unrollSafely() and has its own logic 
> for handling graceful fallback to disk when cached data does not fit in 
> memory. However, this logic also exists inside of the MemoryStore itself, so 
> this appears to be unnecessary duplication.
> We can remove this duplication and delete a significant amount of 
> BlockManager code which existed only to support this CacheManager code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to