Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22752#discussion_r226409012
--- Diff: core/src/main/scala/org/apache/spark/deploy/history/config.scala
---
@@ -64,4 +64,11 @@ private[spark] object config {
.bytesConf(ByteUnit.BYTE)
.createWithDefaultString("1m")
+ val IN_PROGRESS_ABSOLUTE_LENGTH_CHECK =
+ ConfigBuilder("spark.history.fs.inProgressAbsoluteLengthCheck.enabled")
--- End diff --
Is there any disadvantage in just leaving this always on? Otherwise this
doesn't need to be configurable.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
