wubx opened a new issue, #9675: URL: https://github.com/apache/seatunnel/issues/9675
### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description I have test the main use ``` source { MySQL-CDC { base-url="jdbc:mysql://192.168.1.100:3306/wubx" username="wubx" password="wubxwubx" table-names=["wubx.t01"] startup.mode="initial" } } sink { S3File { bucket = "s3a://mystage" tmp_path = "/tmp/SeaTunnel/${table_name}" path="/mysql/${table_name}" fs.s3a.endpoint="http://192.168.1.100:9900"; fs.s3a.aws.credentials.provider="org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider" access_key = "minioadmin" secret_key = "minioadmin" file_format_type="maxwell_json" schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST" data_save_mode="APPEND_DATA" } } ``` ./bin/seatunnel.sh --config ./config/v2.mysql.streaming.s3.conf -m local SQL ``` update t01 set c1='debezium_json' where id=7; ``` debezium format ``` {"before":{"id":7,"c1":"test"},"after":null,"op":"d"} {"before":null,"after":{"id":7,"c1":"debezium_json"},"op":"c"} ``` maxwell format update t01 set c1='debezium_json10' where id=7; ``` {"data":{"id":7,"c1":"debezium_json"},"type":"DELETE"} {"data":{"id":7,"c1":"debezium_json10"},"type":"INSERT"} ``` From the usage, a time field(ts_ms) is required in this format to indicate the generation time of the record. This makes it convenient to obtain the status of the last record. Full debezium json , source section is also very useful. If the file contains sources that are useful for batch Change Data Capture (CDC) for multiple tables. ``` { "before": { "id": 111, "name": "scooter", "description": "Big 2-wheel scooter ", "weight": 5.18 }, "after": { "id": 111, "name": "scooter", "description": "Big 2-wheel scooter ", "weight": 5.17 }, "source": { "version": "1.1.1.Final", "connector": "mysql", "name": "dbserver1", "ts_ms": 1589362330000, "snapshot": "false", "db": "inventory", "table": "products", "server_id": 223344, "gtid": null, "file": "mysql-bin.000003", "pos": 2090, "row": 0, "thread": 2, "query": null }, "op": "u", "ts_ms": 1589362330904, "transaction": null } ``` Previously, there was no need for a "ts_ms" field at all. ### Usage Scenario _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
