Lianhui Wang created SPARK-4621:
-----------------------------------
Summary: when sort- based shuffle, Cache recently used shuffle
index can reduce indexFile's io
Key: SPARK-4621
URL: https://issues.apache.org/jira/browse/SPARK-4621
Project: Spark
Issue Type: Improvement
Components: Shuffle
Reporter: Lianhui Wang
Priority: Critical
in IndexShuffleBlockManager, we can use LRUCache to store recently finished
shuffle index and that can reduce indexFile's io.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
