ZHANG Wei created SPARK-31516: --------------------------------- Summary: Non-existed metric hiveClientCalls.count of CodeGenerator in Monitoring Doc Key: SPARK-31516 URL: https://issues.apache.org/jira/browse/SPARK-31516 Project: Spark Issue Type: Improvement Components: Documentation, Spark Core Affects Versions: 3.0.0 Reporter: ZHANG Wei
There is a duplicated `hiveClientCalls.count` metric in both `namespace=HiveExternalCatalog` and `namespace=CodeGenerator` bullet lists of [Spark Monitoring doc|https://spark.apache.org/docs/3.0.0-preview2/monitoring.html#component-instance--executor], but there is only one of object HiveCatalogMetrics in [source code|https://github.com/apache/spark/blob/6550d0d5283efdbbd838f3aeaf0476c7f52a0fb1/core/src/main/scala/org/apache/spark/metrics/source/StaticSources.scala#L85]. {quote} * namespace=HiveExternalCatalog ** *note:*: these metrics are conditional to a configuration parameter: {{spark.metrics.staticSources.enabled}} (default is true) ** fileCacheHits.count ** filesDiscovered.count ** +{color:#ff0000}*hiveClientCalls.count*{color}+ ** parallelListingJobCount.count ** partitionsFetched.count * namespace=CodeGenerator ** *note:*: these metrics are conditional to a configuration parameter: {{spark.metrics.staticSources.enabled}} (default is true) ** compilationTime (histogram) ** generatedClassSize (histogram) ** generatedMethodSize (histogram) ** *{color:#ff0000}+hiveClientCalls.count+{color}* ** sourceCodeSize (histogram){quote} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org