Hi, Spark's configuration file (useful to retrieve metrics), namely //conf/metrics.properties/, states what follows:
Within an instance, a "source" specifies a particular set of grouped metrics. there are two kinds of sources: 1. Spark internal sources, like /MasterSource/, /WorkerSource/, etc, which will collect a Spark component's internal state. Each instance is paired with a Spark source that is added automatically. 2. Common sources, like /JvmSource/, which will collect low level state. These can be added through configuration options and are then loaded using reflection. Some examples follow, as *master.source.jvm.class=org.apache.spark.metrics.source.JvmSource * Yet, there is no example explaining how to get metrics from other sources as /MasterSource/ or /WorkerSource/, and just replacing JvmSource is not doing the trick. Suggestions? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-configuration-file-metrics-properties-tp23985.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
