dongjoon-hyun commented on a change in pull request #25370: [SPARK-28639][CORE][DOC] Configuration doc for Barrier Execution Mode URL: https://github.com/apache/spark/pull/25370#discussion_r312269212
########## File path: docs/configuration.md ########## @@ -2018,6 +2018,50 @@ Apart from these, the following properties are also available, and may be useful </tr> </table> +### Barrier Execution Mode + +<table class="table"> +<tr><th>Property Name></th><th>Default</th><th>Meaning</th></tr> +<tr> + <td><code>spark.barrier.sync.timeout</code></td> + <td>365d</td> + <td> + The timeout in seconds for each barrier() call from a barrier task. If the + coordinator didn't receive all the sync messages from barrier tasks within the + configed time, throw a SparkException to fail all the tasks. The default value is set + to 31536000(3600 * 24 * 365) so the barrier() call shall wait for one year. + </td> +</tr> +<tr> + <td><code>spark.scheduler.barrier.maxConcurrentTasksCheck.interval</code></td> + <td>15s</td> + <td> + Time in seconds to wait between a max concurrent tasks check failure and the next Review comment: `tasks` -> `task`? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
