[
https://issues.apache.org/jira/browse/SPARK-28352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28352:
---------------------------------
Summary: Spark UI shows RDD blocks as 0 in some executor metrics (was:
Spark UI misses some executor metrics)
> Spark UI shows RDD blocks as 0 in some executor metrics
> -------------------------------------------------------
>
> Key: SPARK-28352
> URL: https://issues.apache.org/jira/browse/SPARK-28352
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.4.1
> Reporter: Burak KÖSE
> Priority: Minor
> Attachments: executor_page.png, executor_summary.png, storage_page.png
>
>
> We have recently migrated our application from 2.2.1 to 2.4.1. We have
> realized that Spark UI is missing some critical information or shows wrong
> ones.
> We have a big cluster, with 80+ executors. It is Spark Streaming with
> customer receivers. On Spark UI in storage tab, we can see memory blocks and
> their size. This page shows correct information that we can see on Ganglia
> and host level monitors. However, in executor tab, `RDD blocks` shows `0`
> while we have thousands of them in memory. Moreover, `Storage Memory` shows
> incorrect numbers.
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
