Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21526#discussion_r202005442
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -357,6 +357,11 @@ package object config {
.intConf
.createWithDefault(256)
+ private[spark] val HADOOP_OUTPUTCOMMITCOORDINATION_ENABLED =
+ ConfigBuilder("spark.hadoop.outputCommitCoordination.enabled")
+ .booleanConf
--- End diff --
.doc("when enabled, tasks will coordinate with the driver to make sure
that, for a certain partition, at most one task attempt can commit.")
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
