Sital Kedia created SPARK-13369:
-----------------------------------
Summary: Number of consecutive fetch failures for a stage before
the job is aborted should be configurable
Key: SPARK-13369
URL: https://issues.apache.org/jira/browse/SPARK-13369
Project: Spark
Issue Type: Improvement
Affects Versions: 1.6.0
Reporter: Sital Kedia
Currently it is hardcode inside code. We need to make it configurable because
for long running jobs, the chances of fetch failures due to machine reboot is
high and we need a configuration parameter to bump up that number.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
