szehon-ho opened a new issue #2735: URL: https://github.com/apache/iceberg/issues/2735
For 'add_files' procedure, if you run it twice on the same Spark table partition you get another set of manifests pointing to same files, doubling the data. Would it make sense by default to skip, (or fail), if file already exists? And if so, should this be flag based? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
