[jira] [Updated] (SPARK-38679) Expose the number partitions in a stage to TaskContext

[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated SPARK-38679: Description: Add a new api to expose total partition count in the stage belonging to the

[jira] [Updated] (SPARK-38679) Expose the number partitions in a stage to TaskContext

[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated SPARK-38679: Description: Add a new api to expose total partition count in the stage belonging to the

[jira] [Updated] (SPARK-38679) Expose the number partitions in a stage to TaskContext

[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated SPARK-38679: Description: Add a new api to expose total partition count in the stage belonging to the

[jira] [Created] (SPARK-38679) Expose the number partitions in a stage to TaskContext

Venki Korukanti created SPARK-38679: --- Summary: Expose the number partitions in a stage to TaskContext Key: SPARK-38679 URL: https://issues.apache.org/jira/browse/SPARK-38679 Project: Spark

[jira] [Created] (SPARK-36236) RocksDB state store: Add additional metrics for better observability into state store operations

Venki Korukanti created SPARK-36236: --- Summary: RocksDB state store: Add additional metrics for better observability into state store operations Key: SPARK-36236 URL:

[jira] [Created] (SPARK-35896) [SS] Include more granular metrics for stateful operators in StreamingQueryProgress

Venki Korukanti created SPARK-35896: --- Summary: [SS] Include more granular metrics for stateful operators in StreamingQueryProgress Key: SPARK-35896 URL: https://issues.apache.org/jira/browse/SPARK-35896

[jira] [Created] (SPARK-35880) [SS] Track the number of duplicates dropped in streaming dedupe operator

Venki Korukanti created SPARK-35880: --- Summary: [SS] Track the number of duplicates dropped in streaming dedupe operator Key: SPARK-35880 URL: https://issues.apache.org/jira/browse/SPARK-35880

[jira] [Updated] (SPARK-35799) Fix the allUpdatesTimeMs metric measuring in FlatMapGroupsWithStateExec

[ https://issues.apache.org/jira/browse/SPARK-35799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated SPARK-35799: Description: Metric {{allUpdatesTimeMs}} meant to capture the start to end walltime of

[jira] [Created] (SPARK-35799) Fix the allUpdatesTimeMs metric measuring in FlatMapGroupsWithStateExec

Venki Korukanti created SPARK-35799: --- Summary: Fix the allUpdatesTimeMs metric measuring in FlatMapGroupsWithStateExec Key: SPARK-35799 URL: https://issues.apache.org/jira/browse/SPARK-35799

[jira] [Created] (SPARK-35763) Minor refactor of StateStoreCustomMetric

Venki Korukanti created SPARK-35763: --- Summary: Minor refactor of StateStoreCustomMetric Key: SPARK-35763 URL: https://issues.apache.org/jira/browse/SPARK-35763 Project: Spark Issue Type: