szehon-ho commented on PR #16967: URL: https://github.com/apache/iceberg/pull/16967#issuecomment-4943521702
@Priyadarshini-Mitra , taking a little more look at this, you use the source to get a list of files that you want to verify exist in the target, that's it? doesnt the RewriteTablePath action already give you the file list (both source and destination)? i still feel the external copy process should be the one to check that all the source files made it to the destination (and not sure why its related to Iceberg). Or put the question another way, given the file list, why do we need Iceberg knowledge to check all files are copied. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
