Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/3020#discussion_r19633080
--- Diff:
core/src/main/scala/org/apache/spark/storage/StorageStatusListener.scala ---
@@ -90,11 +91,11 @@ class StorageStatusListener extends SparkListener {
/**
* In the local mode, there is a discrepancy between the executor ID
according to the
- * task ("localhost") and that according to SparkEnv ("<driver>"). In
the UI, this
- * results in duplicate rows for the same executor. Thus, in this mode,
we aggregate
- * these two rows and use the executor ID of "<driver>" to be consistent.
+ * task ("localhost") and that according to SparkEnv
(`SparkContext.DRIVER_IDENTIFIER`).
+ * In the UI, this results in duplicate rows for the same executor.
Thus, in this mode,
+ * we aggregate these two rows and use the latter executor ID to be
consistent.
*/
def formatExecutorId(execId: String): String = {
- if (execId == "localhost") "<driver>" else execId
+ if (execId == "localhost") SparkContext.DRIVER_IDENTIFIER else execId
--- End diff --
Ok, I like that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
