Guosmilesmile commented on PR #13426: URL: https://github.com/apache/iceberg/pull/13426#issuecomment-3035386852
Regarding result collection: 1. TaskResult needs to be modified to add a new generic result class. 2. RewriteDataFiles can obtain the number of DataFiles rewritten, but a new operator needs to be added to process this and then merge it with TaskResult. 3. For snapshot expiration, the current method can only get the path as a string. If more information is needed, it may be necessary to adopt an approach similar to Spark’s, where expired files are deleted by comparing two MetaTables. Personally, I don’t think this is very necessary. On the Flink side, it could simply output the paths of the deleted files. This is just my personal opinion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
