[
https://issues.apache.org/jira/browse/FLINK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peiyu updated FLINK-38823:
--------------------------
Description:
pipeline job config :
{code:java}
source:
type: mysql
hostname:
port: 3306
username:
password:
tables: oms_db.tf_b_order,oms_db.tf_b_order_delist
treat-tinyint1-as-boolean.enabled: false
scan.incremental.close-idle-reader.enabled: true
debezium.skipped.operations: d
metadata.list: op_ts,table_name
sink:
type: values
transform:
- source-table: oms_db.tf_b_order
projection: ORDER_ID,CREATED_TIME,OLD_ORDER_NUMBER,op_ts as opts_order
primary-keys: ORDER_ID
- source-table: oms_db.tf_b_order_delist
projection: ORDER_ID,DELIST_ID,CARRIER_NAME,op_ts as opts_order_delist
primary-keys: ORDER_ID
route:
- source-table: oms_db.tf_b_order,oms_db.tf_b_order_delist
sink-table: ods.ods_oms_db_tf_b_order_wide
pipeline:
name: mysql_paimon_wide_table
parallelism: 8 {code}
The initial startup process will encounter an error after about 3 minutes, the
taskmanager will restart, and then it will run normally. However, after the
snapshot phase ends, it cannot enter the incremental phase.
!image-2025-12-19-16-35-37-842.png!
was:
pipeline job config :
{code:java}
source:
type: mysql
hostname:
port: 3306
username:
password:
tables: oms_db.tf_b_order,oms_db.tf_b_order_delist
treat-tinyint1-as-boolean.enabled: false
scan.incremental.close-idle-reader.enabled: true
debezium.skipped.operations: d
metadata.list: op_ts,table_name
sink:
type: values
transform:
- source-table: oms_db.tf_b_order
projection: ORDER_ID,CREATED_TIME,OLD_ORDER_NUMBER,op_ts as opts_order
primary-keys: ORDER_ID
- source-table: oms_db.tf_b_order_delist
projection: ORDER_ID,DELIST_ID,CARRIER_NAME,op_ts as opts_order_delist
primary-keys: ORDER_ID
route:
- source-table: oms_db.tf_b_order,oms_db.tf_b_order_delist
sink-table: ods.ods_oms_db_tf_b_order_wide
pipeline:
name: mysql同步paimon_宽表验证
parallelism: 8 {code}
The initial startup process will encounter an error after about 3 minutes, the
taskmanager will restart, and then it will run normally. However, after the
snapshot phase ends, it cannot enter the incremental phase.
!image-2025-12-19-16-35-37-842.png!
> Error running wide table task
> -----------------------------
>
> Key: FLINK-38823
> URL: https://issues.apache.org/jira/browse/FLINK-38823
> Project: Flink
> Issue Type: Bug
> Components: Flink CDC
> Affects Versions: cdc-3.5.0
> Reporter: peiyu
> Priority: Major
> Attachments: image-2025-12-19-16-35-37-842.png
>
>
> pipeline job config :
> {code:java}
> source:
> type: mysql
> hostname:
> port: 3306
> username:
> password:
> tables: oms_db.tf_b_order,oms_db.tf_b_order_delist
> treat-tinyint1-as-boolean.enabled: false
> scan.incremental.close-idle-reader.enabled: true
> debezium.skipped.operations: d
> metadata.list: op_ts,table_name
> sink:
> type: values
> transform:
> - source-table: oms_db.tf_b_order
> projection: ORDER_ID,CREATED_TIME,OLD_ORDER_NUMBER,op_ts as opts_order
> primary-keys: ORDER_ID
> - source-table: oms_db.tf_b_order_delist
> projection: ORDER_ID,DELIST_ID,CARRIER_NAME,op_ts as opts_order_delist
> primary-keys: ORDER_ID
> route:
> - source-table: oms_db.tf_b_order,oms_db.tf_b_order_delist
> sink-table: ods.ods_oms_db_tf_b_order_wide
> pipeline:
> name: mysql_paimon_wide_table
> parallelism: 8 {code}
> The initial startup process will encounter an error after about 3 minutes,
> the taskmanager will restart, and then it will run normally. However, after
> the snapshot phase ends, it cannot enter the incremental phase.
> !image-2025-12-19-16-35-37-842.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
