Luca Canali created SPARK-31711:
-----------------------------------
Summary: Register the executor source with the metrics system when
running in local mode.
Key: SPARK-31711
URL: https://issues.apache.org/jira/browse/SPARK-31711
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.0.0
Reporter: Luca Canali
The Apache Spark metrics system provides many useful insights on the Spark
workload. In particular, the [executor source
metrics](https://github.com/apache/spark/blob/master/docs/monitoring.md#component-instance--executor)
provide detailed info, including number of active tasks, some I/O metrics, and
task metrics details. Executor source, contrary to other sources (for example
ExecutorMetrics source), are not yet available when running in local mode.
This JIRA proposes to register the executor source with the Spark metrics
system when running in local mode, as this can be very useful when testing and
troubleshooting Spark workloads.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
