Wenchen Fan created SPARK-6394:
----------------------------------
Summary: cleanup BlockManager companion object and improve the
getCacheLocs method in DAGScheduler
Key: SPARK-6394
URL: https://issues.apache.org/jira/browse/SPARK-6394
Project: Spark
Issue Type: Improvement
Components: Spark Core
Reporter: Wenchen Fan
Priority: Minor
The current implementation of getCacheLocs include searching a HashMap many
times, we can avoid this.
And BlockManager.blockIdsToExecutorIds isn't called anywhere, we can remove it.
Also we can combine BlockManager.blockIdsToHosts and blockIdsToBlockManagers
into a single method in order to remove some unnecessary layers of indirection
/ collection creation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
