Re: [PR] [FLINK-35313][mysql-cdc] Add upsert changelog mode to avoid UPDATE_BEFORE records … [flink-cdc]

[via GitHub]

yeezychao commented on PR #1907:
URL: https://github.com/apache/flink-cdc/pull/1907#issuecomment-2105588522

   > > @yuxiqian Turning on upsert mode still fails to filter -u data. I am 
very confused as to why the same PR application failed to test in cdc 3.2 
(flink 1.18) version, but it still works in version 2.2 (flink 1.15). 
Unfortunately, I have not found the reason yet. 
![image](https://private-user-images.githubusercontent.com/18387619/329751040-32609ad6-9730-4bf5-83c6-91f1343dc617.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTU0MDA1MjAsIm5iZiI6MTcxNTQwMDIyMCwicGF0aCI6Ii8xODM4NzYxOS8zMjk3NTEwNDAtMzI2MDlhZDYtOTczMC00YmY1LTgzYzYtOTFmMTM0M2RjNjE3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA1MTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNTExVDA0MDM0MFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTI1NjQzNjYzN2I2YTU3NzAwYjA0ZDkzODIxMTU0ZTc2ZjQ1YmFiYmZmOTViNzk1MDNmNzBmNDkzYjIwMmIwNGUmWC1BbXotU2lnbmVkSGVhZG
 
Vycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.kfPitV5gbKlL5u6DiGPoxjmPCZUsBpg62S5dTlOigrs)
   > 
   > @yeezychao Maybe check the output log and confirm if MySQL source actually 
sends any `-U` events to downstream? IIRC Flink will automatically append a 
`ChangelogNormalize` node to backfill missing update before events if source 
doesn't provide it.
   
   You are right！The `ChangelogNormalize` node is indeed added under the Flink 
1.18 version，but the Flink 1.15 version haven't.
   
![image](https://github.com/apache/flink-cdc/assets/18387619/f25a44fe-df3a-43d6-b48e-98fc1be487d8)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org