Andreas Neumann created SPARK-57358:
---------------------------------------
Summary: SCD1 SQL API without ignore nulls
Key: SPARK-57358
URL: https://issues.apache.org/jira/browse/SPARK-57358
Project: Spark
Issue Type: Sub-task
Components: Declarative Pipelines
Affects Versions: 4.3.0
Reporter: Andreas Neumann
Implement the SQL parser for AUTO CDC with SCD TYPE 1:
*Form* *1:* *CREATE* *FLOW* *...* *AS* *AUTO* *CDC* {*}INTO{*}{*}{*}
{{CREATE FLOW <flow_name> [COMMENT '<comment>'] AS}}{{
AUTO CDC INTO <target_table>}}{{
FROM <source>}}{{ K
EYS (<key1>, <key2>, ...)}}{{
SEQUENCE BY <expr>}}{{
[APPLY AS DELETE WHEN <condition>]}}{{
[COLUMNS <col1>, <col2>, ...]}}{{{}
[COLUMNS * EXCEPT (<col1>, <col2>, ...)]{}}}{{{}{}}}
*Form* *2:* *CREATE* *STREAMING* *TABLE* *...* *FLOW* *AUTO* {*}CDC{*}{*}{*}
{{CREATE [OR REFRESH] STREAMING TABLE <table_name>}}{{
}}{{[IF NOT EXISTS]}}{{
[(column_definitions)] [USING provider]}}{{
[table_clauses]}}{{
FLOW AUTO CDC}}{{
FROM <source>}}{{
KEYS (<key1>, <key2>, ...)}}{{
SEQUENCE BY <expr>}}{{
[APPLY AS DELETE WHEN <condition>]}}{{
[COLUMNS <col1>, <col2>, ...]}}{{{}
[COLUMNS * EXCEPT (<col1>, <col2>, ...)]{}}}{{{}{}}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
