Jungtaek Lim created SPARK-26170:
------------------------------------
Summary: Add missing metrics in FlatMapGroupsWithState
Key: SPARK-26170
URL: https://issues.apache.org/jira/browse/SPARK-26170
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 3.0.0
Reporter: Jungtaek Lim
Credit to [~jlaskowski]: I can't change reporter so please try to change it if
you would like to registered as reporter of this issue.
Unlike other operators like StateStoreSaveExec, StreamingDeduplicateExec, and
StreamingGlobalLimitExec, FlatMapGroupsWithStateExec doesn't measure available
metrics in StateStoreWriter, so only part of metrics are measured in
setStoreMetrics.
This issue is to track the effort to measure all possible metrics from
FlatMapGroupsWithStateExec. Some metrics will be kept unavailable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
