Jungtaek Lim created SPARK-56839:
------------------------------------
Summary: Remove dev loop config for new state format of
stream-stream join
Key: SPARK-56839
URL: https://issues.apache.org/jira/browse/SPARK-56839
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 4.2.0, 4.3.0
Reporter: Jungtaek Lim
We made a code complete about new state format in stream-stream join in Apache
Spark 4.2.0, but forgot about removing the config which was a gate to prevent
the feature to be released "in the middle". Since all code changes have been
made into 4.2.0, the flag is unnecessary.
They still need to opt-in the state format version, so that's effectively
playing a gate even though we remove the gate config. Keeping the gate config
is just more verbose.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
