[jira] [Commented] (FLINK-32587) The results returned from the CDC sql query are null or the value was changed unexpectly
[
https://issues.apache.org/jira/browse/FLINK-32587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750208#comment-17750208
]
jasonliangyc commented on FLINK-32587:
--
Hi [~jiabao.sun] , thanks for your advices and after serveral tests with the
new version file: flink-sql-connector-sqlserver-cdc-2.4.1.jar, now i only found
one issue still exist, that is the NULL still returned.
!image-2023-08-02-17-09-14-671.png|width=556,height=151!
!image-2023-08-02-17-18-06-375.png|width=549,height=268!
> The results returned from the CDC sql query are null or the value was changed
> unexpectly
>
>
> Key: FLINK-32587
> URL: https://issues.apache.org/jira/browse/FLINK-32587
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.17.0, 1.17.1
>Reporter: jasonliangyc
>Priority: Critical
> Attachments: image-2023-07-13-17-35-32-235.png,
> image-2023-07-13-17-37-56-908.png, image-2023-07-21-14-48-31-572.png,
> image-2023-08-02-16-40-32-476.png, image-2023-08-02-16-43-25-458.png,
> image-2023-08-02-17-03-05-932.png, image-2023-08-02-17-07-19-295.png,
> image-2023-08-02-17-09-14-671.png, image-2023-08-02-17-10-03-889.png,
> image-2023-08-02-17-18-06-375.png
>
>
> I created a CDC table(the sqlserver source table has more than 100 columns)
> as below and then run the query 'select * from so_cdc' through sql-client, it
> gives me the unexpected results.
> {code:java}
> CREATE TABLE so_cdc (
> REC_ID STRING,
> Create_Date TIMESTAMP(3),
> PRIMARY KEY (REC_ID) NOT ENFORCED
> ) WITH (
> 'connector' = 'sqlserver-cdc',
> 'hostname' = '',
> 'port' = '',
> 'username' = 'xxx',
> 'password' = '',
> 'database-name' = '',
> 'schema-name' = '',
> 'table-name' = 'xxx',
> 'scan.startup.mode' = 'latest-offset'
> ); {code}
> Run the query for the first time, the data look normal.
> !image-2023-07-13-17-35-32-235.png|width=535,height=141!
>
> But after i run the same query multiple times, it gives me the unexpected
> data, and i'm sure that these two columns of my sqlserver source table don't
> contain these data.
> And i found that the values of 'REC_ID' were actually the values of another
> column in the sqlserver source table, it seems the query returned the wrong
> columns.
> Above sqlserver source table is in the production database and i can't
> reproduce the same issue in dev db.
> !image-2023-07-21-14-48-31-572.png|width=533,height=159!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-32587) The results returned from the CDC sql query are null or the value was changed unexpectly
[
https://issues.apache.org/jira/browse/FLINK-32587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750126#comment-17750126
]
Jiabao Sun commented on FLINK-32587:
Thanks [~jasonliangyc] .
There's a known issue that old version's sqlserver cdc connector will subscribe
the same table of different database and that problem was fixed by the 2.4.1
version. But the problem of unexpected data from same table is never reported
before.
You can check whether the table of same name exists in different databases and
try to use the latest version of the connector to see if this problem still
exists.
> The results returned from the CDC sql query are null or the value was changed
> unexpectly
>
>
> Key: FLINK-32587
> URL: https://issues.apache.org/jira/browse/FLINK-32587
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.17.0, 1.17.1
>Reporter: jasonliangyc
>Priority: Critical
> Attachments: image-2023-07-13-17-35-32-235.png,
> image-2023-07-13-17-37-56-908.png, image-2023-07-21-14-48-31-572.png
>
>
> I created a CDC table(the sqlserver source table has more than 100 columns)
> as below and then run the query 'select * from so_cdc' through sql-client, it
> gives me the unexpected results.
> {code:java}
> CREATE TABLE so_cdc (
> REC_ID STRING,
> Create_Date TIMESTAMP(3),
> PRIMARY KEY (REC_ID) NOT ENFORCED
> ) WITH (
> 'connector' = 'sqlserver-cdc',
> 'hostname' = '',
> 'port' = '',
> 'username' = 'xxx',
> 'password' = '',
> 'database-name' = '',
> 'schema-name' = '',
> 'table-name' = 'xxx',
> 'scan.startup.mode' = 'latest-offset'
> ); {code}
> Run the query for the first time, the data look normal.
> !image-2023-07-13-17-35-32-235.png|width=535,height=141!
>
> But after i run the same query multiple times, it gives me the unexpected
> data, and i'm sure that these two columns of my sqlserver source table don't
> contain these data.
> And i found that the values of 'REC_ID' were actually the values of another
> column in the sqlserver source table, it seems the query returned the wrong
> columns.
> Above sqlserver source table is in the production database and i can't
> reproduce the same issue in dev db.
> !image-2023-07-21-14-48-31-572.png|width=533,height=159!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-32587) The results returned from the CDC sql query are null or the value was changed unexpectly
[
https://issues.apache.org/jira/browse/FLINK-32587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750120#comment-17750120
]
jasonliangyc commented on FLINK-32587:
--
Hi [~jiabao.sun] , got it, I will create an issue in github cdc and my
configurations are as below:
flink: 1.17.0
flink-connector-jdbc-3.1.1-1.17.jar
flink-sql-connector-sqlserver-cdc-2.3.0.jar
mssql-jdbc-12.2.0.jre8.jar
sqlserver: Microsoft SQL Server 2014
> The results returned from the CDC sql query are null or the value was changed
> unexpectly
>
>
> Key: FLINK-32587
> URL: https://issues.apache.org/jira/browse/FLINK-32587
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.17.0, 1.17.1
>Reporter: jasonliangyc
>Priority: Critical
> Attachments: image-2023-07-13-17-35-32-235.png,
> image-2023-07-13-17-37-56-908.png, image-2023-07-21-14-48-31-572.png
>
>
> I created a CDC table(the sqlserver source table has more than 100 columns)
> as below and then run the query 'select * from so_cdc' through sql-client, it
> gives me the unexpected results.
> {code:java}
> CREATE TABLE so_cdc (
> REC_ID STRING,
> Create_Date TIMESTAMP(3),
> PRIMARY KEY (REC_ID) NOT ENFORCED
> ) WITH (
> 'connector' = 'sqlserver-cdc',
> 'hostname' = '',
> 'port' = '',
> 'username' = 'xxx',
> 'password' = '',
> 'database-name' = '',
> 'schema-name' = '',
> 'table-name' = 'xxx',
> 'scan.startup.mode' = 'latest-offset'
> ); {code}
> Run the query for the first time, the data look normal.
> !image-2023-07-13-17-35-32-235.png|width=535,height=141!
>
> But after i run the same query multiple times, it gives me the unexpected
> data, and i'm sure that these two columns of my sqlserver source table don't
> contain these data.
> And i found that the values of 'REC_ID' were actually the values of another
> column in the sqlserver source table, it seems the query returned the wrong
> columns.
> Above sqlserver source table is in the production database and i can't
> reproduce the same issue in dev db.
> !image-2023-07-21-14-48-31-572.png|width=533,height=159!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-32587) The results returned from the CDC sql query are null or the value was changed unexpectly
[
https://issues.apache.org/jira/browse/FLINK-32587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749932#comment-17749932
]
Jiabao Sun commented on FLINK-32587:
Thanks [~jasonliangyc] to report this problem.
It is recommended that you create an issue in
[https://github.com/ververica/flink-cdc-connectors/issues] so that more
maintainers will see it and try to fix it.
It would be helpful if you could provide the version of sqlserver, the version
of the flink cdc connector, and the table structure of sqlserver.
> The results returned from the CDC sql query are null or the value was changed
> unexpectly
>
>
> Key: FLINK-32587
> URL: https://issues.apache.org/jira/browse/FLINK-32587
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.17.0, 1.17.1
>Reporter: jasonliangyc
>Priority: Critical
> Attachments: image-2023-07-13-17-35-32-235.png,
> image-2023-07-13-17-37-56-908.png, image-2023-07-21-14-48-31-572.png
>
>
> I created a CDC table(the sqlserver source table has more than 100 columns)
> as below and then run the query 'select * from so_cdc' through sql-client, it
> gives me the unexpected results.
> {code:java}
> CREATE TABLE so_cdc (
> REC_ID STRING,
> Create_Date TIMESTAMP(3),
> PRIMARY KEY (REC_ID) NOT ENFORCED
> ) WITH (
> 'connector' = 'sqlserver-cdc',
> 'hostname' = '',
> 'port' = '',
> 'username' = 'xxx',
> 'password' = '',
> 'database-name' = '',
> 'schema-name' = '',
> 'table-name' = 'xxx',
> 'scan.startup.mode' = 'latest-offset'
> ); {code}
> Run the query for the first time, the data look normal.
> !image-2023-07-13-17-35-32-235.png|width=535,height=141!
>
> But after i run the same query multiple times, it gives me the unexpected
> data, and i'm sure that these two columns of my sqlserver source table don't
> contain these data.
> And i found that the values of 'REC_ID' were actually the values of another
> column in the sqlserver source table, it seems the query returned the wrong
> columns.
> Above sqlserver source table is in the production database and i can't
> reproduce the same issue in dev db.
> !image-2023-07-21-14-48-31-572.png|width=533,height=159!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
