Eric Marnadi created SPARK-49050:
------------------------------------
Summary: Integrate TransformWithState operator with Virtual Column
Families
Key: SPARK-49050
URL: https://issues.apache.org/jira/browse/SPARK-49050
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 4.0.0
Reporter: Eric Marnadi
Instead of creating a new column family for each new state variable, we want to
use virtual column families. We need to write the columnFamilyId to the State
Schema file, and read this in and pass this into the StateStoreProvider.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
