[
https://issues.apache.org/jira/browse/SPARK-40807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacek Laskowski updated SPARK-40807:
------------------------------------
Summary: "RocksDB: commit - pause bg time total" metric always 0 (was:
RocksDBStateStore always 0 for "RocksDB: commit - pause bg time total" metric)
> "RocksDB: commit - pause bg time total" metric always 0
> -------------------------------------------------------
>
> Key: SPARK-40807
> URL: https://issues.apache.org/jira/browse/SPARK-40807
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
> Affects Versions: 3.3.0
> Reporter: Jacek Laskowski
> Priority: Minor
> Attachments: spark-streams-commit-pause-bg-time.png
>
>
> {{RocksDBStateStore}} uses
> [pauseBg|https://github.com/apache/spark/blob/v3.3.0/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreProvider.scala#L131]
> key to report "RocksDB: commit - pause bg time" metric while {{RocksDB}}
> uses
> [pause|https://github.com/apache/spark/blob/v3.3.0/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/RocksDB.scala#L308]
> to provide a value every commit. That leads to a name mismatch and 0
> reported (as the default value for no metrics).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
