tgravescs commented on code in PR #43863:
URL: https://github.com/apache/spark/pull/43863#discussion_r1400695829
##########
docs/configuration.md:
##########
@@ -522,6 +522,27 @@ of the most common options to set are:
</td>
<td>3.2.0</td>
</tr>
+<tr>
+ <td><code>spark.executor.maxNumFailures</code></td>
+ <td>numExecutors * 2, with minimum of 3</td>
+ <td>
+ Spark exits if the number of failed executors exceeds this threshold.
+ This configuration only takes effect on YARN, or Kubernetes when
+ `spark.kubernetes.allocation.pods.allocator` is set to 'direct'.
+ </td>
+ <td>3.5.0</td>
+</tr>
+<tr>
+ <td><code>spark.executor.failuresValidityInterval</code></td>
+ <td>(none)</td>
+ <td>
+ Interval after which Executor failures will be considered independent and
Review Comment:
```suggestion
Interval after which executor failures will be considered independent and
```
##########
docs/configuration.md:
##########
@@ -522,6 +522,27 @@ of the most common options to set are:
</td>
<td>3.2.0</td>
</tr>
+<tr>
+ <td><code>spark.executor.maxNumFailures</code></td>
+ <td>numExecutors * 2, with minimum of 3</td>
+ <td>
+ Spark exits if the number of failed executors exceeds this threshold.
Review Comment:
```suggestion
The maximum number of executor failures before failing the application.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
