Josh Rosen created SPARK-12817:
----------------------------------
Summary: Simplify CacheManager code and remove unused BlockManager
methods
Key: SPARK-12817
URL: https://issues.apache.org/jira/browse/SPARK-12817
Project: Spark
Issue Type: Improvement
Components: Block Manager
Reporter: Josh Rosen
Assignee: Josh Rosen
CacheManager directly calls MemoryStore.unrollSafely() and has its own logic
for handling graceful fallback to disk when cached data does not fit in memory.
However, this logic also exists inside of the MemoryStore itself, so this
appears to be unnecessary duplication.
We can remove this duplication and delete a significant amount of BlockManager
code which existed only to support this CacheManager code.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]