[
https://issues.apache.org/jira/browse/SPARK-48223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mason Chen updated SPARK-48223:
-------------------------------
Description:
PrometheusServlet does not work well with queryName in the metric name.
For driver metrics, the configuration `spark.metrics.namespace` allows the user
to remove the app id from the metric name to build reusable dashboards and
metric queries in external systems.
Similarly, we need a feature to replace the query name in the spark streaming
metric names to make dashboards and metric queries reusable. Ideally, the query
name would be generated as a tag, instead of part of the metric name.
This can be enabled if a feature flag is enabled, to not break existing users
who are dependent of the existing metric format.
was:
PrometheusServlet does not work well with queryName in the metric name.
For driver metrics, the configuration `spark.metrics.namespace` allows the user
to remove the app id from the metric name to build reusable dashboards and
metric queries in external systems.
Similarly, we need a feature to replace the query name in the spark streaming
metric names to make dashboards and metric queries reusable. Ideally, the query
name would be generated as a tag, instead of part of the metric name.
> PrometheusServlet does not work well with queryName in the metric name
> ----------------------------------------------------------------------
>
> Key: SPARK-48223
> URL: https://issues.apache.org/jira/browse/SPARK-48223
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.5.1, 3.3.4, 3.4.3
> Reporter: Mason Chen
> Priority: Major
>
> PrometheusServlet does not work well with queryName in the metric name.
> For driver metrics, the configuration `spark.metrics.namespace` allows the
> user to remove the app id from the metric name to build reusable dashboards
> and metric queries in external systems.
> Similarly, we need a feature to replace the query name in the spark streaming
> metric names to make dashboards and metric queries reusable. Ideally, the
> query name would be generated as a tag, instead of part of the metric name.
> This can be enabled if a feature flag is enabled, to not break existing users
> who are dependent of the existing metric format.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
