[jira] [Updated] (SPARK-48199) [Arbitrary State Support] Allow users to set EventTime timestamp properly in TransformWithState for watermark evaluation

2024-05-08 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhuwan Sahni updated SPARK-48199: - Epic Link: SPARK-46815 > [Arbitrary State Support] Allow users to set EventTime timestamp

[jira] [Created] (SPARK-48199) [Arbitrary State Support] Allow users to set EventTime timestamp properly in TransformWithState for watermark evaluation

2024-05-08 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-48199: Summary: [Arbitrary State Support] Allow users to set EventTime timestamp properly in TransformWithState for watermark evaluation Key: SPARK-48199 URL:

[jira] [Created] (SPARK-47960) Support Chaining Stateful Operators in TransformWithState

2024-04-23 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-47960: Summary: Support Chaining Stateful Operators in TransformWithState Key: SPARK-47960 URL: https://issues.apache.org/jira/browse/SPARK-47960 Project: Spark

[jira] [Updated] (SPARK-47840) Remove foldable propagation across Streaming Aggregate/Join nodes

2024-04-12 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhuwan Sahni updated SPARK-47840: - Description: Streaming queries with Union of 2 data streams followed by an Aggregate (groupBy)

[jira] [Updated] (SPARK-47840) Remove foldable propagation across Streaming Aggregate/Join nodes

2024-04-12 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhuwan Sahni updated SPARK-47840: - Description: Streaming queries with Union of 2 data streams followed by an Aggregate (groupBy)

[jira] [Created] (SPARK-47840) Remove foldable propagation across Streaming Aggregate/Join nodes

2024-04-12 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-47840: Summary: Remove foldable propagation across Streaming Aggregate/Join nodes Key: SPARK-47840 URL: https://issues.apache.org/jira/browse/SPARK-47840 Project: Spark

[jira] [Created] (SPARK-47568) Fix race condition between maintenance thread and task thead for RocksDB snapshot

2024-03-26 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-47568: Summary: Fix race condition between maintenance thread and task thead for RocksDB snapshot Key: SPARK-47568 URL: https://issues.apache.org/jira/browse/SPARK-47568

[jira] [Commented] (SPARK-47558) [Arbitrary State Support] State TTL support - ValueState

2024-03-26 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830977#comment-17830977 ] Bhuwan Sahni commented on SPARK-47558: -- https://github.com/apache/spark/pull/45674 > [Arbitrary

[jira] [Created] (SPARK-47558) [Arbitrary State Support] State TTL support - ValueState

2024-03-25 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-47558: Summary: [Arbitrary State Support] State TTL support - ValueState Key: SPARK-47558 URL: https://issues.apache.org/jira/browse/SPARK-47558 Project: Spark

[jira] [Created] (SPARK-47036) RocksDB versionID Mismatch in SST files with Compaction

2024-02-13 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-47036: Summary: RocksDB versionID Mismatch in SST files with Compaction Key: SPARK-47036 URL: https://issues.apache.org/jira/browse/SPARK-47036 Project: Spark

[jira] [Commented] (SPARK-46928) Support ListState in Arbitrary State API v2

2024-01-31 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812820#comment-17812820 ] Bhuwan Sahni commented on SPARK-46928: -- PR submitted -

[jira] [Created] (SPARK-46928) Support ListState in Arbitrary State API v2

2024-01-30 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-46928: Summary: Support ListState in Arbitrary State API v2 Key: SPARK-46928 URL: https://issues.apache.org/jira/browse/SPARK-46928 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-22 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809657#comment-17809657 ] Bhuwan Sahni commented on SPARK-46796: -- PR created - [https://github.com/apache/spark/pull/44837]

[jira] [Commented] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-22 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809634#comment-17809634 ] Bhuwan Sahni commented on SPARK-46796: -- Working on a PR for the fix. > RocksDB versionID Mismatch

[jira] [Created] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-22 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-46796: Summary: RocksDB versionID Mismatch in SST files Key: SPARK-46796 URL: https://issues.apache.org/jira/browse/SPARK-46796 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-45655) current_date() not supported in Streaming Query Observed metrics

2023-10-24 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779264#comment-17779264 ] Bhuwan Sahni commented on SPARK-45655: -- PR link https://github.com/apache/spark/pull/43517 >

[jira] [Created] (SPARK-45655) current_date() not supported in Streaming Query Observed metrics

2023-10-24 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-45655: Summary: current_date() not supported in Streaming Query Observed metrics Key: SPARK-45655 URL: https://issues.apache.org/jira/browse/SPARK-45655 Project: Spark

[jira] [Commented] (SPARK-45655) current_date() not supported in Streaming Query Observed metrics

2023-10-24 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779239#comment-17779239 ] Bhuwan Sahni commented on SPARK-45655: -- I am working on a fix for this issue, and will submit a PR