Jing Zhan created SPARK-47363:
---------------------------------

             Summary: Initial State without state reader implementation for 
State API v2.
                 Key: SPARK-47363
                 URL: https://issues.apache.org/jira/browse/SPARK-47363
             Project: Spark
          Issue Type: Task
          Components: Structured Streaming
    Affects Versions: 4.0.0
            Reporter: Jing Zhan


This PR adds support for users to provide a Dataframe that can be used to 
instantiate state for the query in the first batch for arbitrary state API v2.

Note that populating the initial state will only happen for the first batch of 
the new streaming query. Trying to re-initialize state for the same grouping 
key will result in an error.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to