Jun Fang created SPARK-6396:
-------------------------------
Summary: Add timeout control for broadcast
Key: SPARK-6396
URL: https://issues.apache.org/jira/browse/SPARK-6396
Project: Spark
Issue Type: Improvement
Components: Block Manager, Spark Core
Affects Versions: 1.3.0, 1.3.1
Reporter: Jun Fang
Priority: Minor
TorrentBroadcast uses fetchBlockSync method of BlockTransferService.scala which
call Await.result(result.future, Duration.Inf). In production environment this
may cause a hang out when driver and executor are in different date centers. A
timeout here would be better.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]