[
https://issues.apache.org/jira/browse/SPARK-20955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033664#comment-16033664
]
Shixiong Zhu commented on SPARK-20955:
--------------------------------------
In [this
line|https://github.com/apache/spark/blob/f7cf2096fdecb8edab61c8973c07c6fc877ee32d/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala#L128],
it uses the executorId string received from executors and finally it will go
into TaskUIData. As deserializing the executorId string will always create a
new instance, we have a lot of duplicated string instances.
> A lot of duplicated "executorId" strings in "TaskUIData"s
> ----------------------------------------------------------
>
> Key: SPARK-20955
> URL: https://issues.apache.org/jira/browse/SPARK-20955
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.1.1
> Reporter: Shixiong Zhu
> Assignee: Shixiong Zhu
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
