Repository: spark Updated Branches: refs/heads/branch-2.0 0cc36cad1 -> fb944a1e8
[SPARK-16650] Improve documentation of spark.task.maxFailures Clarify documentation on spark.task.maxFailures No tests run as its documentation Author: Tom Graves <[email protected]> Closes #14287 from tgravescs/SPARK-16650. (cherry picked from commit 6c56fff118ff2380c661456755db17976040de66) Signed-off-by: Sean Owen <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fb944a1e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/fb944a1e Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/fb944a1e Branch: refs/heads/branch-2.0 Commit: fb944a1e85a4d0e618cf7485afb0d0b39367fbda Parents: 0cc36ca Author: Tom Graves <[email protected]> Authored: Fri Jul 22 12:41:38 2016 +0100 Committer: Sean Owen <[email protected]> Committed: Fri Jul 22 12:41:46 2016 +0100 ---------------------------------------------------------------------- docs/configuration.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/fb944a1e/docs/configuration.md ---------------------------------------------------------------------- diff --git a/docs/configuration.md b/docs/configuration.md index 1e95b86..86a9bd9 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1188,7 +1188,9 @@ Apart from these, the following properties are also available, and may be useful <td><code>spark.task.maxFailures</code></td> <td>4</td> <td> - Number of individual task failures before giving up on the job. + Number of failures of any particular task before giving up on the job. + The total number of failures spread across different tasks will not cause the job + to fail; a particular task has to fail this number of attempts. Should be greater than or equal to 1. Number of allowed retries = this value - 1. </td> </tr> --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
