mxm opened a new pull request, #17142: URL: https://github.com/apache/iceberg/pull/17142
This adds the option to run `ConvertEqualityDeletes` as a post-commit maintenance task on `IcebergSink`, similarly to the RewriteDataFiles / ExpireSnapshots / DeleteOrphanFiles post-commit integration. The sink's write branch becomes the converter's staging branch. The target branch defaults to the same branch (in-place conversion). This is also configurable via options on the builder, as well as via properties (see ConvertEqualityDeletesConfig). Equality field columns are derived from the resolved equality field ids of the sink, to ensure they match with the sink's equality fields. Documentation changes are in separate commits. Ideally, they should be preserved to make backporting of the code changes more straight-forward. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
