xloya opened a new issue #3789: URL: https://github.com/apache/iceberg/issues/3789
Can we support adding the min-sequence-number of referenced data file in the position delete file's manifest entry? I think there are two benefits: 1. In the case of using startingSequenceNumber, when rewriting, it can judge whether the newly added position delete file has deleted this rewrite and previous data files, and more accurately judge whether the rewrite commit is allowed, otherwise the conflict probability is very high in the streaming scene. 2. The second is that with this metric, we can choose position-delete files whose the min sequence number are equal or greater than the data file when applying delete files, reducing the number of scanned files. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
