[
https://issues.apache.org/jira/browse/SPARK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174747#comment-14174747
]
Nan Zhu commented on SPARK-3957:
--------------------------------
Ok, when i work on executor tab, i rwslize that, we eventually need a
per-executor record of broadcast usage....so will still follow the heartbeat
based strategy
> Broadcast variable memory usage not reflected in UI
> ---------------------------------------------------
>
> Key: SPARK-3957
> URL: https://issues.apache.org/jira/browse/SPARK-3957
> Project: Spark
> Issue Type: Bug
> Components: Block Manager, Web UI
> Affects Versions: 1.0.2, 1.1.0
> Reporter: Shivaram Venkataraman
> Assignee: Nan Zhu
>
> Memory used by broadcast variables are not reflected in the memory usage
> reported in the WebUI. For example, the executors tab shows memory used in
> each executor but this number doesn't include memory used by broadcast
> variables. Similarly the storage tab only shows list of rdds cached and how
> much memory they use.
> We should add a separate column / tab for broadcast variables to make it
> easier to debug.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
