pdambrauskas commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-584129585 @dongjoon-hyun nice to see this feature on Spark 3.0. :+1: . I wanted to ask you, if you have any ides, how hard would it be to transform metric keys to Prometheus labels? Is it possible at this point? Or is it more feasible to use Prometheus relabel feature, something like this: ```yaml - job_name: spark relabel_configs: - source_labels: ['__name__'] regex: 'metrics_(\w+)_(\w+)_.*' target_label: 'app_id' replacement: '$1-$2' - source_labels: ['__name__'] regex: 'metrics_(\w+)_(\w+)_(.*)' target_label: '__name__' replacement: 'spark_$3' ``` I saw you did some job on labeling executor metrics, but in this case we have only metric keys from metric registry, so we cannot really be sure how to label each part of metric key?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
