Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/22473#discussion_r219940593 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -83,6 +83,17 @@ package object config { private[spark] val EXECUTOR_CLASS_PATH = ConfigBuilder(SparkLauncher.EXECUTOR_EXTRA_CLASSPATH).stringConf.createOptional + private[spark] val EXECUTOR_HEARTBEAT_DROP_ZERO_METRICS = + ConfigBuilder("spark.executor.heartbeat.dropZeroMetrics").booleanConf.createWithDefault(true) --- End diff -- @srowen Since the user can see these accumulator updates in the public API `SparkListenerExecutorMetricsUpdate`, I would prefer to add a flag in case someone really needs these zero updates. E.g., a user may use the listener API to get all accumulators used in a task. After this change, they cannot get them until the task finishes.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org