Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2432#discussion_r18313711
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -200,6 +209,7 @@ class SparkContext(config: SparkConf) extends Logging {
private[spark] val listenerBus = new LiveListenerBus
// Create the Spark execution environment (cache, map output tracker,
etc)
+ conf.set("spark.executor.id", "driver")
--- End diff --
I think the idea is that certain types of metrics can be generated by
components that run on both drivers and executors (e.g. BlockManager metrics)
and we'd like to capture the location where the metric is generated as part of
the metric name.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
