davidzollo commented on issue #10204: URL: https://github.com/apache/seatunnel/issues/10204#issuecomment-3665338091
I think it's not proper for SeaTunnel to do `Post-Synchronization Data Validation`, SeaTunnel should make every effort to ensure data consistency during data synchronization, while the consistency verification after synchronization should be handled by a third party, such as a scheduling system. The essential work of SeaTunnel is to synchronize data from the source to the target as quickly as possible. Verifying data consistency after data synchronization is also very resource-intensive, and this should be handled by computing engines such as Spark. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
