Anish Mahto created SPARK-56838:
-----------------------------------
Summary: Introduce AutoCDC parameters dataclass
Key: SPARK-56838
URL: https://issues.apache.org/jira/browse/SPARK-56838
Project: Spark
Issue Type: Sub-task
Components: Declarative Pipelines
Affects Versions: 4.2.0, 4.3.0
Reporter: Anish Mahto
As per the SPIP, the AutoCDC API supports a number of different parameters (ex.
delete condition, key set, include/exclude columns).
SDP needs a way to represent these API parameters. Introduce a dataclass to
model the base SCD1/SCD2 parameters.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
