Jing Zhan created SPARK-47363:
---------------------------------
Summary: Initial State without state reader implementation for
State API v2.
Key: SPARK-47363
URL: https://issues.apache.org/jira/browse/SPARK-47363
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 4.0.0
Reporter: Jing Zhan
This PR adds support for users to provide a Dataframe that can be used to
instantiate state for the query in the first batch for arbitrary state API v2.
Note that populating the initial state will only happen for the first batch of
the new streaming query. Trying to re-initialize state for the same grouping
key will result in an error.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]