mxm opened a new pull request, #16858: URL: https://github.com/apache/iceberg/pull/16858
Adds EqualityConvertDVWriter, a two input operator keyed by data file path for the equality delete conversion task. It consumes the DVPositions emitted by EqualityConvertPKIndex and produces a DVWriteResult for the committer. Keying by data file path collects every position for a data file on one task, so the operator can write exactly one DV per file. Positions are buffered until the watermark reaches the cycle's plan timestamp, broadcast on the second input, at which point the operator resolves and writes the DVs. Existing DVs, including staging DVs for newly added data files, are folded into the rewrite because V3 allows only one DV per data file. Delete manifests are first pruned by partition summary to bound reads to the cycle's affected partitions rather than the table's full DV history. The operator fails fast if the main branch snapshot changed since planning. On an upstream abort signal or a write failure it emits DVWriteResult.ABORT to ensure the committer doesn't commit partial results. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
