[
https://issues.apache.org/jira/browse/FLINK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-41058:
-----------------------------------
Labels: pull-request-available (was: )
> Fluss pipeline sink ignores table options defined in transform rules
> --------------------------------------------------------------------
>
> Key: FLINK-41058
> URL: https://issues.apache.org/jira/browse/FLINK-41058
> Project: Flink
> Issue Type: New Feature
> Components: Flink CDC
> Affects Versions: cdc-3.7.0
> Reporter: Hongshun Wang
> Assignee: Hongshun Wang
> Priority: Major
> Labels: pull-request-available
> Fix For: cdc-3.8.0
>
>
> The Fluss pipeline sink currently ignores {{table-options}}?? ??configured in
> transform rules when automatically creating tables.
>
> Transform rules propagate these options through {{{}Schema.options(){}}}.
> However, {{FlussMetaDataApplier}} only uses the global {{properties.table.*}}
> options from the sink configuration. The Paimon sink already merges both
> sources.
>
> For example,
> {code:java}
> transform:
> - source-table: inventory.products
> projection: "*"
> table-options: table.replication.factor=2,table.log.ttl=7d
> sink:
> type: fluss
> bootstrap.servers: localhost:9123
> properties.table.replication.factor: 3 {code}
> Expected behavior:
> * The table created for inventory.products has a replication factor of 2 and
> a log retention time of 7 days.
> * Table-specific options override matching global sink options.
> * Other global options remain effective, and other tables are unaffected.
>
> Actual behavior:
> * The table uses the global replication factor of 3.
> * The transform-defined log retention setting is ignored.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)