[
https://issues.apache.org/jira/browse/SPARK-31516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-31516.
-----------------------------------
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28292
[https://github.com/apache/spark/pull/28292]
> Non-existed metric hiveClientCalls.count of CodeGenerator in Monitoring Doc
> ---------------------------------------------------------------------------
>
> Key: SPARK-31516
> URL: https://issues.apache.org/jira/browse/SPARK-31516
> Project: Spark
> Issue Type: Improvement
> Components: Documentation, Spark Core
> Affects Versions: 3.0.0
> Reporter: ZHANG Wei
> Assignee: ZHANG Wei
> Priority: Minor
> Fix For: 3.0.0
>
>
> There is a duplicated `hiveClientCalls.count` metric in both
> `namespace=HiveExternalCatalog` and `namespace=CodeGenerator` bullet lists
> of [Spark Monitoring
> doc|https://spark.apache.org/docs/3.0.0-preview2/monitoring.html#component-instance--executor],
> but there is only one inside object HiveCatalogMetrics in [source
> code|https://github.com/apache/spark/blob/6550d0d5283efdbbd838f3aeaf0476c7f52a0fb1/core/src/main/scala/org/apache/spark/metrics/source/StaticSources.scala#L85].
> {quote} * namespace=HiveExternalCatalog
> ** *note:*: these metrics are conditional to a configuration parameter:
> {{spark.metrics.staticSources.enabled}} (default is true)
> ** fileCacheHits.count
> ** filesDiscovered.count
> ** +{color:#ff0000}*hiveClientCalls.count*{color}+
> ** parallelListingJobCount.count
> ** partitionsFetched.count
> * namespace=CodeGenerator
> ** *note:*: these metrics are conditional to a configuration parameter:
> {{spark.metrics.staticSources.enabled}} (default is true)
> ** compilationTime (histogram)
> ** generatedClassSize (histogram)
> ** generatedMethodSize (histogram)
> ** *{color:#ff0000}+hiveClientCalls.count+{color}*
> ** sourceCodeSize (histogram){quote}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
