liunaijie commented on issue #6725: URL: https://github.com/apache/seatunnel/issues/6725#issuecomment-2063114470
mysql cdc default format will generate 2 record when upstream data updated, one record is delete one record is insert. and if you change the format to `compatible_debezium_json`, it will only generate 1 update record. You can change the sink to `Console` then to check the result. For your case, you use hive as destination, hive is not support update, delete operation. also cdc will generate a lots of small file. maybe it's not a good idea. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
