sharkd tu created SPARK-24678:
---------------------------------
Summary: We should use 'PROCESS_LOCAL' first for Spark-Streaming
Key: SPARK-24678
URL: https://issues.apache.org/jira/browse/SPARK-24678
Project: Spark
Issue Type: Improvement
Components: Block Manager
Affects Versions: 2.3.1
Reporter: sharkd tu
Currently, the meta-info of blocks that were received by spark-streaming
receivers only contains hosts info, which results in subsequent schedule level
is not better than 'NODE_LOCAL'. We can just make a small changes, the schedule
level can be improved to 'PROCESS_LOCAL'
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
