Github user kayousterhout commented on a diff in the pull request:
https://github.com/apache/spark/pull/17307#discussion_r106337950
--- Diff: docs/configuration.md ---
@@ -1506,6 +1506,11 @@ Apart from these, the following properties are also
available, and may be useful
of this setting is to act as a safety-net to prevent runaway
uncancellable tasks from rendering
an executor unusable.
</td>
+ <td><code>spark.stage.maxConsecutiveAttempts</code></td>
+ <td>4</td>
+ <td>
+ Number of consecutive stage retries allowed before a stage is aborted.
--- End diff --
Hah sorry for all of the comment changes from the combination of Imran and
me!! But I agree that this was an issue before and would be good to update.
Thanks for the many updates here @sitalkedia.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
