[
https://issues.apache.org/jira/browse/FLINK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
suhwan updated FLINK-39055:
---------------------------
Description:
*Summary*
In the Iceberg table version 3, default value support for columns
[https://iceberg.apache.org/spec/#version-3-extended-types-and-capabilities]
But now, Iceberg pipeline sink connector does not propagate column default
values when creating tables (CreateTableEvent) or adding columns
(AddColumnEvent)
I think that this can fix Column.getDefaultValueExpression() call in
IcebergMetadataApplier or IcebergTypeUtils.
I refered it
- Paimon sink SchemaChangeProvider:
[https://github.com/apache/flink-cdc/blob/1c597444886ad3dde268a8adc1f5a0871c768360/flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/SchemaChangeProvider.java#L58-L69]
was:
Summary
In the Iceberg table version 3, Default value support for columns
[https://iceberg.apache.org/spec/#version-3-extended-types-and-capabilities]
But now, Iceberg pipeline sink connector does not propagate column default
values when creating tables (CreateTableEvent) or adding columns
(AddColumnEvent)
I think that this can fix Column.getDefaultValueExpression() call in
IcebergMetadataApplier or IcebergTypeUtils.
I refered it
- Paimon sink SchemaChangeProvider:
https://github.com/apache/flink-cdc/blob/1c597444886ad3dde268a8adc1f5a0871c768360/flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/SchemaChangeProvider.java#L58-L69
> [Iceberg] Support default column values in Iceberg sink connector
> -----------------------------------------------------------------
>
> Key: FLINK-39055
> URL: https://issues.apache.org/jira/browse/FLINK-39055
> Project: Flink
> Issue Type: New Feature
> Components: Flink CDC
> Reporter: suhwan
> Priority: Not a Priority
>
> *Summary*
> In the Iceberg table version 3, default value support for columns
> [https://iceberg.apache.org/spec/#version-3-extended-types-and-capabilities]
>
> But now, Iceberg pipeline sink connector does not propagate column default
> values when creating tables (CreateTableEvent) or adding columns
> (AddColumnEvent)
>
> I think that this can fix Column.getDefaultValueExpression() call in
> IcebergMetadataApplier or IcebergTypeUtils.
> I refered it
> - Paimon sink SchemaChangeProvider:
> [https://github.com/apache/flink-cdc/blob/1c597444886ad3dde268a8adc1f5a0871c768360/flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/SchemaChangeProvider.java#L58-L69]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
