rameshkrishnan muthusamy created SPARK-44741:
------------------------------------------------

             Summary: Spark StatsD metrics reported to support metrics filter 
option 
                 Key: SPARK-44741
                 URL: https://issues.apache.org/jira/browse/SPARK-44741
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.4.1
            Reporter: rameshkrishnan muthusamy


Spark statsd metrics sink in the current state does not support metrics 
filtering option. 

Though this option is available in the reporters it is not exposed in the 
statsD sink. An example of this can be looked at 
[https://github.com/apache/spark/blob/be9ffb37585fe421705ceaa52fe49b89c50703a3/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala#L76]

 

This is a critical option to have when teams does not want all the metrics that 
are exposed by spark in the metrics monitoring platforms and switch to detailed 
metrics as and when needed. 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to