Anish Mahto created SPARK-57265:
-----------------------------------
Summary: AutoCDC Flow Execution; Introduce and Integrate SCD2
`Scd2MergeStreamingWrite`
Key: SPARK-57265
URL: https://issues.apache.org/jira/browse/SPARK-57265
Project: Spark
Issue Type: Sub-task
Components: Declarative Pipelines
Affects Versions: 4.3.0
Reporter: Anish Mahto
Introduce the physical flow for AutoCDC SCD2 executions, which actually
executes the core SCD2 algorithm to reconcile an incoming microbatch.
The physical flow is also responsible for managing the aux table
lifecycle/schema.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
