Thorne created FLINK-36996:
------------------------------
Summary: The schema and namespace of MySQL pipeline connector
metadata are reversed
Key: FLINK-36996
URL: https://issues.apache.org/jira/browse/FLINK-36996
Project: Flink
Issue Type: Bug
Components: Flink CDC
Environment: flink :1.18.0
flink-cdc 3.2.1
doris:2.1
Reporter: Thorne
Fix For: cdc-3.3.0
Attachments: image-2025-01-02-23-36-53-097.png,
image-2025-01-02-23-44-28-707.png, image-2025-01-02-23-47-31-644.png
1、mysql2doris yaml with metadata config
{code:java}
//代码占位符
################################################################################
# Description: Sync MySQL all tables to Doris
################################################################################
source:
type: mysql
hostname: localhost
port: 3306
username: root
password: 123456
tables: app_db.\.*
server-id: 5400-5404
server-time-zone: UTC
sink:
type: doris
fenodes: 127.0.0.1:8030
username: root
password: ""
table.create.properties.light_schema_change: true
table.create.properties.replication_num: 1
transform:
- source-table: app_db.orders
projection: \*, __namespace_name__ as dbname, __schema_name__ as
schema_name, __table_name__ as tb_name
description: access metadata columns from source table pipeline:
name: Sync MySQL Database to Doris
parallelism: 2
{code}
2、The results from doris's app_db.orders table will be show
!image-2025-01-02-23-44-28-707.png!
3、we can see that I get the wrong results because of the flink-cdc's [Metadata
relationship|https://nightlies.apache.org/flink/flink-cdc-docs-master/docs/core-concept/transform/#metadata-relationship]
!image-2025-01-02-23-47-31-644.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
